-- Logs begin at Mon 2022-06-20 05:13:40 UTC, end at Mon 2022-06-20 06:36:40 UTC. -- Jun 20 05:58:58.941925 dv-cinder-804735-31-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 20 05:58:58.951832 dv-cinder-804735-31-smb devstack@keystone.service[80260]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 20 05:58:58.953850 dv-cinder-804735-31-smb devstack@keystone.service[80260]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 05:58:58 2022] *** Jun 20 05:58:58.953850 dv-cinder-804735-31-smb devstack@keystone.service[80260]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 05:58:58.953850 dv-cinder-804735-31-smb devstack@keystone.service[80260]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 05:58:58.953850 dv-cinder-804735-31-smb devstack@keystone.service[80260]: nodename: dv-cinder-804735-31-smb Jun 20 05:58:58.953850 dv-cinder-804735-31-smb devstack@keystone.service[80260]: machine: x86_64 Jun 20 05:58:58.953850 dv-cinder-804735-31-smb devstack@keystone.service[80260]: clock source: unix Jun 20 05:58:58.953850 dv-cinder-804735-31-smb devstack@keystone.service[80260]: pcre jit disabled Jun 20 05:58:58.953850 dv-cinder-804735-31-smb devstack@keystone.service[80260]: detected number of CPU cores: 4 Jun 20 05:58:58.953850 dv-cinder-804735-31-smb devstack@keystone.service[80260]: current working directory: / Jun 20 05:58:58.953850 dv-cinder-804735-31-smb devstack@keystone.service[80260]: detected binary path: /usr/bin/uwsgi-core Jun 20 05:58:58.953850 dv-cinder-804735-31-smb devstack@keystone.service[80260]: your processes number limit is 47680 Jun 20 05:58:58.954449 dv-cinder-804735-31-smb devstack@keystone.service[80260]: your memory page size is 4096 bytes Jun 20 05:58:58.954449 dv-cinder-804735-31-smb devstack@keystone.service[80260]: detected max file descriptor number: 2048 Jun 20 05:58:58.954449 dv-cinder-804735-31-smb devstack@keystone.service[80260]: lock engine: pthread robust mutexes Jun 20 05:58:58.954449 dv-cinder-804735-31-smb devstack@keystone.service[80260]: thunder lock: enabled Jun 20 05:58:58.954449 dv-cinder-804735-31-smb devstack@keystone.service[80260]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 20 05:58:58.954449 dv-cinder-804735-31-smb devstack@keystone.service[80260]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 05:58:58.998774 dv-cinder-804735-31-smb devstack@keystone.service[80260]: Python main interpreter initialized at 0x5637b49509c0 Jun 20 05:58:58.998774 dv-cinder-804735-31-smb devstack@keystone.service[80260]: python threads support enabled Jun 20 05:58:58.998774 dv-cinder-804735-31-smb devstack@keystone.service[80260]: your server socket listen backlog is limited to 100 connections Jun 20 05:58:58.998774 dv-cinder-804735-31-smb devstack@keystone.service[80260]: your mercy for graceful operations on workers is 90 seconds Jun 20 05:58:58.999106 dv-cinder-804735-31-smb devstack@keystone.service[80260]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 05:58:58.999183 dv-cinder-804735-31-smb devstack@keystone.service[80260]: *** Operational MODE: preforking *** Jun 20 05:58:58.999458 dv-cinder-804735-31-smb devstack@keystone.service[80260]: *** uWSGI is running in multiple interpreter mode *** Jun 20 05:58:58.999458 dv-cinder-804735-31-smb devstack@keystone.service[80260]: spawned uWSGI master process (pid: 80260) Jun 20 05:58:58.999651 dv-cinder-804735-31-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 20 05:58:59.000727 dv-cinder-804735-31-smb devstack@keystone.service[80260]: spawned uWSGI worker 1 (pid: 80270, cores: 1) Jun 20 05:58:59.000727 dv-cinder-804735-31-smb devstack@keystone.service[80260]: spawned uWSGI worker 2 (pid: 80271, cores: 1) Jun 20 05:58:59.000727 dv-cinder-804735-31-smb devstack@keystone.service[80260]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 05:59:04.513663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:59:04.513663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: from cryptography.utils import int_from_bytes Jun 20 05:59:04.514479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:59:04.514479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: from cryptography.utils import int_from_bytes Jun 20 05:59:04.514894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:59:04.514894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: from cryptography.utils import int_from_bytes Jun 20 05:59:04.514997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:59:04.514997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: from cryptography.utils import int_from_bytes Jun 20 05:59:04.562954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 05:59:04.563133 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 05:59:04.563214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 05:59:04.563297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 05:59:04.563376 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] command line args: [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 05:59:04.563453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] command line args: [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 05:59:04.563587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 05:59:04.563731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 05:59:04.563818 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ================================================================================ {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 05:59:04.563897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ================================================================================ {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 05:59:04.564010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] admin_token = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.564159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] admin_token = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.564249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] config_dir = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.564407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] config_dir = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.564487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.564598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] config_source = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.564706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.564787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] debug = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.564870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] config_source = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.564981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] debug = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.565066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.565235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.565396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.565485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.565551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.565766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.565896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.566013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.566132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.566253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.566373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.566493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] log_config_append = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.566619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] log_config_append = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.566735 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.566848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.566967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] log_dir = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.567087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] log_dir = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.567208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] log_file = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.567334 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] log_file = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.567449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.567568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.567682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.567796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.567899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.568001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.568114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.568220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.568317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.568429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.568541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.568688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.568776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.568895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.569010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.569093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.569177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.569293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.569369 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.569483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.569558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.569678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.569766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.569847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.569971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.570050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.570121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.570197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.570277 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.570352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.570742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.570925 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] publish_errors = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.571068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.571149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.571266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] publish_errors = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.571376 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.571468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.571541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.571707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.571826 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.571908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.571998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.572137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.572224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] standard_threads = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.572379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.572464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.572638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] standard_threads = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.572776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.572904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.572981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.573058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] use_journal = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.573130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.573207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] use_json = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.573289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.573361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] use_stderr = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.573455 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] use_journal = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.573538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] use_syslog = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.573635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] use_json = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.573753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.573834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] use_stderr = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.573981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] use_syslog = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.574064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.574219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:59:04.574304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.574484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.574570 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.574722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.574800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.574973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.575051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.575215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.575301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.575466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.575550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.575703 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.575781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.575952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.576030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.576197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.576282 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.576448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.576526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.576722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.576805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.576976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.577062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.577215 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.577299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.577462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.577546 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.577702 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.577785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.577938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.578016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.578194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.578275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.578438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.578562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.578682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.578760 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.578921 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.579002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.579176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.579256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.579416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.579494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.579675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.579760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.579921 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.579999 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.580155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.580233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.580387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.580467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.580634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.580727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.580882 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.580961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.581119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.581197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.581362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.581447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.581592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.581681 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.581823 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.581902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.582069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.582148 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.582310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.582400 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.582547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.582624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.582794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.582872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.583026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.583113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.583262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.583342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.583498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.583576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.583726 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.583882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.583963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.584041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.584173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.584290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.584386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.584506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.584641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.584728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.584878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.584967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.585109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.585201 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.585353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.585432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.585585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.585670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.585823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.585912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.586574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.586664 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.587400 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.587575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.587652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.587737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.587815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.587815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.588029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.588127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.588256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.588365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.588462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.588565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.588688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.588789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.588884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.588997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.589079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.589191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.589277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.589351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.589475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.589555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.589640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.589715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.589847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.589971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.590049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.590166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.590250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.590331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.590411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.590529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.590605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.590710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.590797 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.590949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.591030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.591200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.591281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.591444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.591525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.591683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.591767 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.591921 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.592003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.592161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.592259 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.592405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.592485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.592667 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.592763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.592911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.593003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.593157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.593253 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.593395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.593475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.593634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.593721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.593870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.593949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.594108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.594188 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.594345 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.594432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.594583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.594661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.594826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.594906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.595067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.595155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.595304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.595390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.595546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.595633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.595792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.595948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.596025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.596104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.596253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.596334 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.596485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.596573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.596742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.596837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.596960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.597037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.597200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.597280 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.597432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.597525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.597669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.597749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.597904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.597983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.598137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.598228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.598380 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.598493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.598619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.598697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.598873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.598962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.599115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.599193 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.599348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.external = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.599433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.599579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.599673 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.599854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.599933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.600091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.external = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.600170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.600321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.password = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.600410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.600551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] auth.token = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.600714 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.600803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.600879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.601047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.601127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.password = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.601299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.601381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.token = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.601534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.601720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.602348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.602469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.602703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.602786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.602948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.603028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.603184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.603263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.603435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.603517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.603670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.603750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.603914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.603994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.604150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.604230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.604394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.604474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.604677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.604773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.604904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.604984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.605156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.605236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.605393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.605472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.605648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.605735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.605908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.605986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.606153 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.606241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.606413 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.606494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.606653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.606733 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.606913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.606993 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.607157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.607239 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.607400 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.607479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.607662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.607742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.607915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.607997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.608148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.608228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.608398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.608477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.608659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.608743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.608899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.608979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.609150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.609229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.609389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.609470 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.609635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.609714 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.609878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.609956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.610115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.610196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.610366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.610446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.610615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.610695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.610844 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.610920 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.611082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.611162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.611331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.611420 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.611566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.611653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.611807 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.611886 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.612055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.612141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.612292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.612370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.612528 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.612607 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.612787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.612880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.613020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.613104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.613268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.613348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.613501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.613588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.613739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.613820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.613992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.614071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.614237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.614324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.614486 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.614566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.614737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.614826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.614977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.615067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.615210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.615290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.615448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.615528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.615685 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.615778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.615923 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.616004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.616163 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.616242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.616400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.616489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.616664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.616747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.616901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.616981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.617144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.617278 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.617943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.618015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.618186 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.618256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.618437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.618525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.618671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.618742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.618904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.618975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.619145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.619225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.619377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.619447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.619616 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.619686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.619854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.619934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.620098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.620169 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.620339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.620408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.620583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.620707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.620860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.621216 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.621497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.621783 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.621854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.621925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.622059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.622130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.622327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.622410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.622543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.622648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.622793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.622905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.623020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.623091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.623263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.623343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.623526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.623673 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.623741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.623835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.623991 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.624071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.624240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.624310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.624490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.624559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.624752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.624827 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.624985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.625055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.625222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.625292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.625460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.625536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.625703 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.625773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.625934 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.626003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.626182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.626253 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.626430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.626500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.626661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.626730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.626906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.626977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.627147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.627216 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.627376 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.627445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.627611 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.628162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.628162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.628275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.628335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.628404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.628466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.628525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.628584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.628669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.629140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.629557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.629689 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.629815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.629942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.630069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.630194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.630330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.630457 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.630592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.630720 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.630847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.630972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.631105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.631232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.631358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.631486 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.631611 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.631740 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.631875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.632001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.632133 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.632259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.632394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.632522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.632678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.632805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.633018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.633642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.633979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.634106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.634199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.634317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.634444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.634572 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.634720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.634899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.635031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.635162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.635292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.635419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.635546 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.635672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.635808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.635935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.636059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.636187 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] role.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.636314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.636441 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] role.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.636691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.636835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.636962 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.637092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.637224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.637350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.637487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.637614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.637747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.637875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.638002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.638131 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.638266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] role.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.638393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.638520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] role.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.638657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.638784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.638909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.639044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.639171 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.639297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.639424 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.639551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.639686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.639815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.639944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.640071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.640198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.640335 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.640335 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.640585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.640728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.640854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.640979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.641106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.641244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.641371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.649616 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.649766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.649900 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.650045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.650203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.650333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.650333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.650578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.650709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.650836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.650973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.651100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.651229 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.651355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.651480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.651606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.651744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.651886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.652013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.652139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.652267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.652394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.652530 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.652672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.652798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.652927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.653053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.653178 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.653315 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.653444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.653571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] token.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.653707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.653835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.653970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.654098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.654230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.654358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.654483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.654609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.654743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.654871 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.654998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.655125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.655252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.655391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.655527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] token.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.655654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.655780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.655908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.656035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.656162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.656296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.656425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.656552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.656820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.656948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.657086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.657221 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.657358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.657485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.657611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.657736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.657863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.657998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.658125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.658252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.658378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.connection = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.658513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.658647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.658775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.658901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.659035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.659171 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.659298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.659677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.659805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.659932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.659932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.660182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.660329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.660454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.660583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.660725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.connection = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.660869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.661009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.661138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.661276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.661402 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.661534 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.661662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.661796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.661924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.662049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.662177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.662305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.662448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.662581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.662712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.662841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.662978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 05:59:04.663629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:59:04.663629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 05:59:04.683686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.683920 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.684054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.684183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.684317 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.684478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.692696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.693051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.721020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.721241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.721614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.721851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.864045 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.864348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.913512 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.913741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.914815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.915056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.978177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.978424 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.978575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.978714 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.978866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.979000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.979132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.979262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.979391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.979530 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.979660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:04.979660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.004766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.005003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.005149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.005279 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.005405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.005531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.005662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.005801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.005932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.006062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.006195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.006324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.006465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.006465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.017219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.017600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.029848 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.030079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.030231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.030366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.030498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.030630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.030781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.030921 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.031052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.031181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.031313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.031442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80271) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.031528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.031528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:59:05.049065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.049272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:59:05.049613 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.049794 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.049938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:59:05.050069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:59:05.050196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.050322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.050447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.050572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:59:05.050705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.050833 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.050959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.051085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.051262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.051521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.062178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.062455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.062726 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.063009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.063160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.063440 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.063712 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.063998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.071468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.072582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.074795 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.075070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.075348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.075627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.075908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.076043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.076172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.076299 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.076426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.076561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.076730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.076863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.076993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.077122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.077250 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.077381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.077519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.077650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.077778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.078040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.078319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.078590 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.104467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.105611 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.106096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.106375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.107245 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.107551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.111648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.112042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.112322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.112894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.113288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.113573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.119767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.119998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.121338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.121790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.124495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.124811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.125098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.125383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.125659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.125931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.126202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.126470 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.128367 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.128803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.129240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.129673 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.130115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.130555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.130982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.131343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.145972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.146247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.151690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.153462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.153743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.155342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.155740 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.158365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.161063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.162301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.162708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.164730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.167943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.168398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.168723 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.169009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.169289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.169566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.169856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.171578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.175280 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.175581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.175867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.176162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.176453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.176772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.189314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.189604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.189869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.190141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.196417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.196719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.197005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.197278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.198600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.200320 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.200594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.203791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.204072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.204679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.205020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.205183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.206912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.207192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.210428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.210715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.211065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.211943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.212305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.218912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.219194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.219489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.219784 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.221313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.221606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.221898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.225677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.225959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.226249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.226530 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.228202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.228502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.228829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.239925 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.243297 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.246643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.246941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.248380 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.250057 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.250282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.250445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.250604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.253636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.255384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.257064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.257345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.257633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.258585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.260133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.263405 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.263696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.264085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.264362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.265642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.267271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.270535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.270829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.271224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.271505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.274161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.274493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.274811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.281332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.281622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.281905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.282737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80271) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.283017 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.283299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.283574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.283845 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.284227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.284793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.285076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.285348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.285623 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.285892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.286156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.286429 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.286704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80271) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.290231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:59:05.290510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.290824 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.291104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.291380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.291761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.292059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.292348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.292647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.292919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.293193 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.293471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.294694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.294968 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:59:05.326219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637b49509c0 pid: 80271 (default app) Jun 20 05:59:05.329703 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d10571-3ca8-44dc-b4e6-2a11946bc91c None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:05.330002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d10571-3ca8-44dc-b4e6-2a11946bc91c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:05.330282 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d10571-3ca8-44dc-b4e6-2a11946bc91c None None] PATH_INFO: `/v3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:05.334024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637b49509c0 pid: 80270 (default app) Jun 20 05:59:05.334495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Mon Jun 20 05:59:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:13.118417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05654f9-8852-4326-b97f-db500ac89fc7 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.118996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05654f9-8852-4326-b97f-db500ac89fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.118996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05654f9-8852-4326-b97f-db500ac89fc7 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.123313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:13.129021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb6fe5-c003-4e5a-90d3-784a434f0fe3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.129453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb6fe5-c003-4e5a-90d3-784a434f0fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.129579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb6fe5-c003-4e5a-90d3-784a434f0fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.199003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: INFO dbcounter [None req-32eb6fe5-c003-4e5a-90d3-784a434f0fe3 None None] Registered counter for database keystone Jun 20 05:59:13.220220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG oslo_db.sqlalchemy.engines [None req-32eb6fe5-c003-4e5a-90d3-784a434f0fe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:59:13.226764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writer thread running {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:59:13.406377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG passlib.handlers.bcrypt [None req-32eb6fe5-c003-4e5a-90d3-784a434f0fe3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80271) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 05:59:13.406721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG passlib.handlers.bcrypt [None req-32eb6fe5-c003-4e5a-90d3-784a434f0fe3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80271) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 05:59:13.461254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-32eb6fe5-c003-4e5a-90d3-784a434f0fe3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:13.462858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-32eb6fe5-c003-4e5a-90d3-784a434f0fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:13.586054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 20 05:59:13.719803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05654f9-8852-4326-b97f-db500ac89fc7 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:13.792319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: INFO dbcounter [None req-f05654f9-8852-4326-b97f-db500ac89fc7 None None] Registered counter for database keystone Jun 20 05:59:13.812194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG oslo_db.sqlalchemy.engines [None req-f05654f9-8852-4326-b97f-db500ac89fc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:59:13.818427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writer thread running {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:59:13.944069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05654f9-8852-4326-b97f-db500ac89fc7 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:13.949055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729826ed-719d-4cbf-8d87-60ecc091f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:13.949724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729826ed-719d-4cbf-8d87-60ecc091f6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:13.950016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729826ed-719d-4cbf-8d87-60ecc091f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:13.950298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729826ed-719d-4cbf-8d87-60ecc091f6ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:13.958851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729826ed-719d-4cbf-8d87-60ecc091f6ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:14.012452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: WARNING keystone.common.rbac_enforcer.enforcer [None req-729826ed-719d-4cbf-8d87-60ecc091f6ff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 05:59:14.012759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729826ed-719d-4cbf-8d87-60ecc091f6ff admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:14.023668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Mon Jun 20 05:59:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 05:59:14.029513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb6fe5-c003-4e5a-90d3-784a434f0fe3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:14.045085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb6fe5-c003-4e5a-90d3-784a434f0fe3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:14.049660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618034bc-3158-487e-956f-936745d5a541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:14.051009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618034bc-3158-487e-956f-936745d5a541 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:14.051258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618034bc-3158-487e-956f-936745d5a541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:14.051394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618034bc-3158-487e-956f-936745d5a541 admin admin] PATH_INFO: `/v3/projects/bc8cc051ad1a43a898b15611374a54c1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:14.056215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618034bc-3158-487e-956f-936745d5a541 admin admin] RBAC: Authorizing `identity:get_project(project_id=bc8cc051ad1a43a898b15611374a54c1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:14.107265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: WARNING keystone.common.rbac_enforcer.enforcer [None req-618034bc-3158-487e-956f-936745d5a541 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 05:59:14.107614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618034bc-3158-487e-956f-936745d5a541 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:14.112394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Mon Jun 20 05:59:14 2022] GET /identity/v3/projects/bc8cc051ad1a43a898b15611374a54c1 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:16.143125 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7967-b823-43c4-8d74-204bca88894f None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.143658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7967-b823-43c4-8d74-204bca88894f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.143756 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7967-b823-43c4-8d74-204bca88894f None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.147843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:16.153318 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f43d2c-bd7c-4bcd-9de1-d018d1bb8baa None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.153684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f43d2c-bd7c-4bcd-9de1-d018d1bb8baa None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.153886 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f43d2c-bd7c-4bcd-9de1-d018d1bb8baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.172677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-05f43d2c-bd7c-4bcd-9de1-d018d1bb8baa None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:16.174209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-05f43d2c-bd7c-4bcd-9de1-d018d1bb8baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:16.182922 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 20 05:59:16.205259 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc7967-b823-43c4-8d74-204bca88894f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.217514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc7967-b823-43c4-8d74-204bca88894f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.221752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010be669-96fc-4e7f-b168-029d8086cdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.222375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010be669-96fc-4e7f-b168-029d8086cdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.222662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010be669-96fc-4e7f-b168-029d8086cdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.222940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010be669-96fc-4e7f-b168-029d8086cdd9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.231504 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010be669-96fc-4e7f-b168-029d8086cdd9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.233311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010be669-96fc-4e7f-b168-029d8086cdd9 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.243010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 05:59:16.248152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f43d2c-bd7c-4bcd-9de1-d018d1bb8baa None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:16.257067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f43d2c-bd7c-4bcd-9de1-d018d1bb8baa None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:16.261478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e8a62-7d34-478d-9d4d-05cdb7b6202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:16.262331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e8a62-7d34-478d-9d4d-05cdb7b6202e admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:16.262617 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e8a62-7d34-478d-9d4d-05cdb7b6202e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:16.262895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e8a62-7d34-478d-9d4d-05cdb7b6202e admin admin] PATH_INFO: `/v3/users/c3f241eb29634e3ba6cabbf8247be6c4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:16.264283 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e8a62-7d34-478d-9d4d-05cdb7b6202e admin admin] RBAC: Authorizing `identity:get_user(user_id=c3f241eb29634e3ba6cabbf8247be6c4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.266148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e8a62-7d34-478d-9d4d-05cdb7b6202e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.267699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Mon Jun 20 05:59:16 2022] GET /identity/v3/users/c3f241eb29634e3ba6cabbf8247be6c4 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:18.326949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fd818-4940-4f69-a242-b434b2de59db None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.327480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fd818-4940-4f69-a242-b434b2de59db None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.327480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fd818-4940-4f69-a242-b434b2de59db None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.328871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:18.333949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1210d-ce2c-4ce7-a9ca-ebb3efb4dfcd None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.334387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1210d-ce2c-4ce7-a9ca-ebb3efb4dfcd None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.334641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1210d-ce2c-4ce7-a9ca-ebb3efb4dfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.352283 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1fd1210d-ce2c-4ce7-a9ca-ebb3efb4dfcd None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:18.353514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1fd1210d-ce2c-4ce7-a9ca-ebb3efb4dfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:18.375520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432859e-1f82-4668-99eb-384117c4fc41 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.375807 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432859e-1f82-4668-99eb-384117c4fc41 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.376082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432859e-1f82-4668-99eb-384117c4fc41 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.377456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:18.382408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71de41-2bd1-4a4e-899d-b508d8dc5ed2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.382696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71de41-2bd1-4a4e-899d-b508d8dc5ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.382976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71de41-2bd1-4a4e-899d-b508d8dc5ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.422271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG passlib.handlers.bcrypt [None req-9f71de41-2bd1-4a4e-899d-b508d8dc5ed2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80270) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 05:59:18.422694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG passlib.handlers.bcrypt [None req-9f71de41-2bd1-4a4e-899d-b508d8dc5ed2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80270) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 05:59:18.435868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:18.459036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1210d-ce2c-4ce7-a9ca-ebb3efb4dfcd None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.468584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9f71de41-2bd1-4a4e-899d-b508d8dc5ed2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:18.470183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9f71de41-2bd1-4a4e-899d-b508d8dc5ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:18.482976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:18.564788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1210d-ce2c-4ce7-a9ca-ebb3efb4dfcd None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:18.569642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:18.591791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71de41-2bd1-4a4e-899d-b508d8dc5ed2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.597696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc04ec-56fe-4a50-81fd-fa4fae6eb437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:18.598495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc04ec-56fe-4a50-81fd-fa4fae6eb437 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.598780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc04ec-56fe-4a50-81fd-fa4fae6eb437 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.599058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc04ec-56fe-4a50-81fd-fa4fae6eb437 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.611129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc04ec-56fe-4a50-81fd-fa4fae6eb437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-19fc04ec-56fe-4a50-81fd-fa4fae6eb437 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:18.623045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:18.624036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:18.625093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:18.629047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:18.629870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc04ec-56fe-4a50-81fd-fa4fae6eb437 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.695279 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71de41-2bd1-4a4e-899d-b508d8dc5ed2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:18.697565 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:18.711516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:18.730704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc04ec-56fe-4a50-81fd-fa4fae6eb437 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:18.733376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed7b73-f1f9-4907-96c1-369fa70ad5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:18.734282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed7b73-f1f9-4907-96c1-369fa70ad5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.734572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed7b73-f1f9-4907-96c1-369fa70ad5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.734852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed7b73-f1f9-4907-96c1-369fa70ad5d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.764664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20dd54-308a-40e9-9ad7-be3bac810368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:18.765341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20dd54-308a-40e9-9ad7-be3bac810368 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.765630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20dd54-308a-40e9-9ad7-be3bac810368 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.765913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20dd54-308a-40e9-9ad7-be3bac810368 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.766665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20dd54-308a-40e9-9ad7-be3bac810368 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:18.766978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20dd54-308a-40e9-9ad7-be3bac810368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:18.768385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20dd54-308a-40e9-9ad7-be3bac810368 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:18.779901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:18.785619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20dd54-308a-40e9-9ad7-be3bac810368 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.801513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed7b73-f1f9-4907-96c1-369fa70ad5d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:18.803031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed7b73-f1f9-4907-96c1-369fa70ad5d1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:18.887663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20dd54-308a-40e9-9ad7-be3bac810368 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:18.899709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:59:18.905587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed7b73-f1f9-4907-96c1-369fa70ad5d1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.908285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:18.928728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b167174-329d-44ba-931c-05b88d59ed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:18.929715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b167174-329d-44ba-931c-05b88d59ed86 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.930008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b167174-329d-44ba-931c-05b88d59ed86 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.930289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b167174-329d-44ba-931c-05b88d59ed86 None admin] PATH_INFO: `/v3/users/c3f241eb29634e3ba6cabbf8247be6c4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.931494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b167174-329d-44ba-931c-05b88d59ed86 None admin] RBAC: Authorizing `identity:get_user(user_id=c3f241eb29634e3ba6cabbf8247be6c4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:18.932998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b167174-329d-44ba-931c-05b88d59ed86 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:18.934624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/users/c3f241eb29634e3ba6cabbf8247be6c4 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:18.939871 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b167174-329d-44ba-931c-05b88d59ed86 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.954640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.006083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed7b73-f1f9-4907-96c1-369fa70ad5d1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.039995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f827103-0e07-401f-ba7b-7b6ad1e36ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.040826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827103-0e07-401f-ba7b-7b6ad1e36ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.041114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827103-0e07-401f-ba7b-7b6ad1e36ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.041396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f827103-0e07-401f-ba7b-7b6ad1e36ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.044001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b167174-329d-44ba-931c-05b88d59ed86 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.059719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f827103-0e07-401f-ba7b-7b6ad1e36ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.061252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f827103-0e07-401f-ba7b-7b6ad1e36ca4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.079798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765e0e8-b50c-4e5e-86ca-05293d1ce368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.080593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765e0e8-b50c-4e5e-86ca-05293d1ce368 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.080912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765e0e8-b50c-4e5e-86ca-05293d1ce368 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.081190 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765e0e8-b50c-4e5e-86ca-05293d1ce368 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.082379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765e0e8-b50c-4e5e-86ca-05293d1ce368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.083833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765e0e8-b50c-4e5e-86ca-05293d1ce368 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-0f827103-0e07-401f-ba7b-7b6ad1e36ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:19.084793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:19.086220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:19.087391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:19.087391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:19.087391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:19.087391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:19.087604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 10/18] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:19.087669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 9/19] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:19.091641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765e0e8-b50c-4e5e-86ca-05293d1ce368 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:19.094349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f827103-0e07-401f-ba7b-7b6ad1e36ca4 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:19.151836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.174233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.194120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765e0e8-b50c-4e5e-86ca-05293d1ce368 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.197301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f827103-0e07-401f-ba7b-7b6ad1e36ca4 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.229023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ef0e1-4332-4625-a02b-7e80ecf6dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.229960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef0e1-4332-4625-a02b-7e80ecf6dd1e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.230251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef0e1-4332-4625-a02b-7e80ecf6dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.230340 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270424bc-79d0-4d1c-8bc4-d20b2fd9dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.230532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef0e1-4332-4625-a02b-7e80ecf6dd1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.230983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270424bc-79d0-4d1c-8bc4-d20b2fd9dd8f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.231277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270424bc-79d0-4d1c-8bc4-d20b2fd9dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.231362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ef0e1-4332-4625-a02b-7e80ecf6dd1e None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.domain.id=default, user.id=c3f241eb29634e3ba6cabbf8247be6c4) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:19.231561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270424bc-79d0-4d1c-8bc4-d20b2fd9dd8f None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.231645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ef0e1-4332-4625-a02b-7e80ecf6dd1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.232293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270424bc-79d0-4d1c-8bc4-d20b2fd9dd8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:19.232658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270424bc-79d0-4d1c-8bc4-d20b2fd9dd8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.233126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ef0e1-4332-4625-a02b-7e80ecf6dd1e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.234022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270424bc-79d0-4d1c-8bc4-d20b2fd9dd8f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.239806 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 11/20] 10.222.0.40 () {56 vars in 1322 bytes} [Mon Jun 20 05:59:19 2022] GET /identity/v3/role_assignments?user.id=c3f241eb29634e3ba6cabbf8247be6c4&scope.domain.id=default&role.id=efc16976111d431c9173186cbd0e6c24 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:19.252965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 10/21] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:21.600164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815cff5-b3df-4290-a313-be931194534d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.600695 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815cff5-b3df-4290-a313-be931194534d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.600803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815cff5-b3df-4290-a313-be931194534d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.602748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 12/22] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:21.614067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae643f-206e-4d5c-b5e0-d225c10763ef None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.614952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae643f-206e-4d5c-b5e0-d225c10763ef None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.615458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae643f-206e-4d5c-b5e0-d225c10763ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.648497 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c0ae643f-206e-4d5c-b5e0-d225c10763ef None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:21.650073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c0ae643f-206e-4d5c-b5e0-d225c10763ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:21.738969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 11/23] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:21.774779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815cff5-b3df-4290-a313-be931194534d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.836245 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4733ac0-f87b-46df-80fb-22ec263c8cc3 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.836941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4733ac0-f87b-46df-80fb-22ec263c8cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.837423 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4733ac0-f87b-46df-80fb-22ec263c8cc3 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.839024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 12/24] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:21.844340 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993783c1-4353-4037-bf33-c90dc5c66ddb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.844923 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993783c1-4353-4037-bf33-c90dc5c66ddb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.845429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993783c1-4353-4037-bf33-c90dc5c66ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.881722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-993783c1-4353-4037-bf33-c90dc5c66ddb None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:21.883370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-993783c1-4353-4037-bf33-c90dc5c66ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:21.969063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:21.972968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815cff5-b3df-4290-a313-be931194534d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.016385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 13/25] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:22.018544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbd006-d62f-4045-aba4-58efcf5add0c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.019179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbd006-d62f-4045-aba4-58efcf5add0c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.019661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbd006-d62f-4045-aba4-58efcf5add0c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.021176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 14/26] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:22.031131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e65b5-19b3-4973-8093-694fc496f5b6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.031131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e65b5-19b3-4973-8093-694fc496f5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.031131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e65b5-19b3-4973-8093-694fc496f5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.038975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db010c-644b-4a51-9da8-7cb04232ea68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.040074 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db010c-644b-4a51-9da8-7cb04232ea68 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.040535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db010c-644b-4a51-9da8-7cb04232ea68 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.040996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db010c-644b-4a51-9da8-7cb04232ea68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.054013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2d8e65b5-19b3-4973-8093-694fc496f5b6 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:22.055249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2d8e65b5-19b3-4973-8093-694fc496f5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:22.070021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db010c-644b-4a51-9da8-7cb04232ea68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-05db010c-644b-4a51-9da8-7cb04232ea68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:22.078447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:22.079601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 13/27] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:22.080548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db010c-644b-4a51-9da8-7cb04232ea68 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.090169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.157735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 15/28] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:22.161705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1721-dbce-42e8-8c7a-217f6af54f29 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.162146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1721-dbce-42e8-8c7a-217f6af54f29 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.162570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1721-dbce-42e8-8c7a-217f6af54f29 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.172302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 16/29] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:22.173331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff1721-dbce-42e8-8c7a-217f6af54f29 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.221463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db010c-644b-4a51-9da8-7cb04232ea68 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.264810 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfddb27-080b-4f15-ab19-be040d52b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.265624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfddb27-080b-4f15-ab19-be040d52b1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.265914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfddb27-080b-4f15-ab19-be040d52b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.266199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfddb27-080b-4f15-ab19-be040d52b1b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.280071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfddb27-080b-4f15-ab19-be040d52b1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.281889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfddb27-080b-4f15-ab19-be040d52b1b9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.294133 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff1721-dbce-42e8-8c7a-217f6af54f29 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.302242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-acfddb27-080b-4f15-ab19-be040d52b1b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:59:22.308716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:22.309828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:22.310813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:59:22.310813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:59:22.310813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:59:22.310813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:22.310813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 14/30] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:22.316415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da8466-2561-4a55-b583-78a1cb199a79 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.316415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da8466-2561-4a55-b583-78a1cb199a79 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.316415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da8466-2561-4a55-b583-78a1cb199a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.336469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f0da8466-2561-4a55-b583-78a1cb199a79 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:22.338129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f0da8466-2561-4a55-b583-78a1cb199a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:22.344307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16e0d0-c9f1-4af4-b649-da43be029a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.345031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16e0d0-c9f1-4af4-b649-da43be029a1a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.345326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16e0d0-c9f1-4af4-b649-da43be029a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.345613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16e0d0-c9f1-4af4-b649-da43be029a1a None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.346376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16e0d0-c9f1-4af4-b649-da43be029a1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:22.346690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16e0d0-c9f1-4af4-b649-da43be029a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.348096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16e0d0-c9f1-4af4-b649-da43be029a1a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.364803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 17/31] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:22.365432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16e0d0-c9f1-4af4-b649-da43be029a1a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.404373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.424738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 15/32] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:22.429874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da8466-2561-4a55-b583-78a1cb199a79 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.493028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16e0d0-c9f1-4af4-b649-da43be029a1a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.539713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd9d4e-2158-4180-9867-7715419767de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.540841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9d4e-2158-4180-9867-7715419767de None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.541334 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9d4e-2158-4180-9867-7715419767de None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.541906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9d4e-2158-4180-9867-7715419767de None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.542886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd9d4e-2158-4180-9867-7715419767de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.544567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd9d4e-2158-4180-9867-7715419767de None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.565366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da8466-2561-4a55-b583-78a1cb199a79 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.601384 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f4d46-ab5e-49d2-84be-e9862e1eefd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.602116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f4d46-ab5e-49d2-84be-e9862e1eefd7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.602349 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f4d46-ab5e-49d2-84be-e9862e1eefd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.602632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f4d46-ab5e-49d2-84be-e9862e1eefd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.603372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f4d46-ab5e-49d2-84be-e9862e1eefd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:22.603687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f4d46-ab5e-49d2-84be-e9862e1eefd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.605142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f4d46-ab5e-49d2-84be-e9862e1eefd7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.628115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 16/33] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:22.628115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f4d46-ab5e-49d2-84be-e9862e1eefd7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.676373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.701723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 18/34] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jun 20 05:59:22 2022] POST /identity/v3/roles => generated 219 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:22.703414 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd9d4e-2158-4180-9867-7715419767de None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.737310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.769758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f4d46-ab5e-49d2-84be-e9862e1eefd7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.824286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd9d4e-2158-4180-9867-7715419767de None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.832362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4580cc-e2d5-4b2f-89e4-f734727e324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.833292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4580cc-e2d5-4b2f-89e4-f734727e324a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.833638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4580cc-e2d5-4b2f-89e4-f734727e324a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.834258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4580cc-e2d5-4b2f-89e4-f734727e324a None admin] PATH_INFO: `/v3/users/c3f241eb29634e3ba6cabbf8247be6c4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.837220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4580cc-e2d5-4b2f-89e4-f734727e324a None admin] RBAC: Authorizing `identity:get_user(user_id=c3f241eb29634e3ba6cabbf8247be6c4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.838842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4580cc-e2d5-4b2f-89e4-f734727e324a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.840768 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 17/35] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/users/c3f241eb29634e3ba6cabbf8247be6c4 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:22.841321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4580cc-e2d5-4b2f-89e4-f734727e324a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:22.865061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd43da-f3f7-4b97-8f5a-b72c3ad2d445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.866138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd43da-f3f7-4b97-8f5a-b72c3ad2d445 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.867214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd43da-f3f7-4b97-8f5a-b72c3ad2d445 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.867699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd43da-f3f7-4b97-8f5a-b72c3ad2d445 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.868727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd43da-f3f7-4b97-8f5a-b72c3ad2d445 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.870581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd43da-f3f7-4b97-8f5a-b72c3ad2d445 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.888235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 19/36] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jun 20 05:59:22 2022] POST /identity/v3/roles => generated 225 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:22.889566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd43da-f3f7-4b97-8f5a-b72c3ad2d445 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.076076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4580cc-e2d5-4b2f-89e4-f734727e324a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.106347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.114871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.139691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd43da-f3f7-4b97-8f5a-b72c3ad2d445 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.145737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d899331-3a4f-4f85-b0b4-63af4b8b232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.146413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899331-3a4f-4f85-b0b4-63af4b8b232c None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.146697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899331-3a4f-4f85-b0b4-63af4b8b232c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.146975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899331-3a4f-4f85-b0b4-63af4b8b232c None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.147724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d899331-3a4f-4f85-b0b4-63af4b8b232c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.150113 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d899331-3a4f-4f85-b0b4-63af4b8b232c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.198294 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d03464-fa39-4693-a274-76dbf6ad547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.199484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d03464-fa39-4693-a274-76dbf6ad547a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.200006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d03464-fa39-4693-a274-76dbf6ad547a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.200484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d03464-fa39-4693-a274-76dbf6ad547a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.203151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d03464-fa39-4693-a274-76dbf6ad547a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.204934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d03464-fa39-4693-a274-76dbf6ad547a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.206907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 20/37] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:23.208513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ab56-dd04-4522-b415-6e44bb1e8a70 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.209082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ab56-dd04-4522-b415-6e44bb1e8a70 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.209562 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ab56-dd04-4522-b415-6e44bb1e8a70 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.211322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 21/38] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:23.216268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ab56-dd04-4522-b415-6e44bb1e8a70 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.303668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 18/39] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:22 2022] POST /identity/v3/projects => generated 301 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:23.306481 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe683-7c88-4068-b1fc-8aed78d190cc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.306805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe683-7c88-4068-b1fc-8aed78d190cc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.307068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe683-7c88-4068-b1fc-8aed78d190cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.327364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-352fe683-7c88-4068-b1fc-8aed78d190cc None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:23.328874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-352fe683-7c88-4068-b1fc-8aed78d190cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:23.342965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ab56-dd04-4522-b415-6e44bb1e8a70 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.380620 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effec31-b520-4ee0-93e1-00a4cfea9dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.381603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effec31-b520-4ee0-93e1-00a4cfea9dd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.381898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effec31-b520-4ee0-93e1-00a4cfea9dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.382796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effec31-b520-4ee0-93e1-00a4cfea9dd2 None admin] PATH_INFO: `/v3/domains/default/users/c3f241eb29634e3ba6cabbf8247be6c4/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.385373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effec31-b520-4ee0-93e1-00a4cfea9dd2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c3f241eb29634e3ba6cabbf8247be6c4, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.386914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effec31-b520-4ee0-93e1-00a4cfea9dd2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.412676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 22/40] 10.222.0.40 () {58 vars in 1361 bytes} [Mon Jun 20 05:59:23 2022] PUT /identity/v3/domains/default/users/c3f241eb29634e3ba6cabbf8247be6c4/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:23.412676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a59e8-9a96-4226-99e6-a43805106823 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.412676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a59e8-9a96-4226-99e6-a43805106823 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.412676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a59e8-9a96-4226-99e6-a43805106823 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.412676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 23/41] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:23.415223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275960e-c1e9-4097-8934-01f734fa6256 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.415517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275960e-c1e9-4097-8934-01f734fa6256 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.415800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275960e-c1e9-4097-8934-01f734fa6256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.437253 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d275960e-c1e9-4097-8934-01f734fa6256 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:23.439174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d275960e-c1e9-4097-8934-01f734fa6256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:23.456849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.534307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 24/42] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:23.536825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 19/43] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:23.559916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275960e-c1e9-4097-8934-01f734fa6256 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.561630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fe683-7c88-4068-b1fc-8aed78d190cc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.677483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275960e-c1e9-4097-8934-01f734fa6256 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.679725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.688180 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fe683-7c88-4068-b1fc-8aed78d190cc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.718251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b8403-0094-40f6-878c-bcd39450f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.719324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b8403-0094-40f6-878c-bcd39450f206 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.719620 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b8403-0094-40f6-878c-bcd39450f206 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.719898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b8403-0094-40f6-878c-bcd39450f206 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.721295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b8403-0094-40f6-878c-bcd39450f206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.723165 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b8403-0094-40f6-878c-bcd39450f206 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.724815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 25/44] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:23.730912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50280a7c-324f-46b7-9902-0eaa48b5c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.731438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b8403-0094-40f6-878c-bcd39450f206 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:23.732105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50280a7c-324f-46b7-9902-0eaa48b5c286 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.732595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50280a7c-324f-46b7-9902-0eaa48b5c286 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.733135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50280a7c-324f-46b7-9902-0eaa48b5c286 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.734315 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50280a7c-324f-46b7-9902-0eaa48b5c286 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.736977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50280a7c-324f-46b7-9902-0eaa48b5c286 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.749580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:23.765239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 20/45] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jun 20 05:59:23 2022] POST /identity/v3/roles => generated 223 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:23.847889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b8403-0094-40f6-878c-bcd39450f206 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:23.886028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa19728-2f16-4b08-a71d-fd8b89271019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:23.886634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa19728-2f16-4b08-a71d-fd8b89271019 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:23.886922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa19728-2f16-4b08-a71d-fd8b89271019 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:23.887204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa19728-2f16-4b08-a71d-fd8b89271019 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:23.887932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa19728-2f16-4b08-a71d-fd8b89271019 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:23.889461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa19728-2f16-4b08-a71d-fd8b89271019 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:23.922852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 26/46] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:23 2022] POST /identity/v3/projects => generated 312 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:25.483731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245295e-0331-4d03-9532-69e9599c5baa None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:25.484252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245295e-0331-4d03-9532-69e9599c5baa None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:25.484342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245295e-0331-4d03-9532-69e9599c5baa None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:25.485877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 21/47] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:25.491190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58616e8c-73ed-46a0-a459-631d68c7767b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:25.491718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58616e8c-73ed-46a0-a459-631d68c7767b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:25.491834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58616e8c-73ed-46a0-a459-631d68c7767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:25.509055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-58616e8c-73ed-46a0-a459-631d68c7767b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:25.510259 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-58616e8c-73ed-46a0-a459-631d68c7767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:25.569485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:25.578761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 27/48] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:25.601920 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245295e-0331-4d03-9532-69e9599c5baa None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:25.707099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245295e-0331-4d03-9532-69e9599c5baa None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:25.740416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e211e14-a455-4f3c-ac1a-2e7ae50452df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:25.741236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e211e14-a455-4f3c-ac1a-2e7ae50452df None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:25.742285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e211e14-a455-4f3c-ac1a-2e7ae50452df None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:25.742608 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e211e14-a455-4f3c-ac1a-2e7ae50452df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:25.754650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e211e14-a455-4f3c-ac1a-2e7ae50452df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-6e211e14-a455-4f3c-ac1a-2e7ae50452df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:25.763557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:25.764529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:25.765426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 22/49] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:25.770507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58616e8c-73ed-46a0-a459-631d68c7767b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:25.868541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58616e8c-73ed-46a0-a459-631d68c7767b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:25.955211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f70ed-c4cc-448d-bb0a-ce9ca560b816 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:25.955502 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f70ed-c4cc-448d-bb0a-ce9ca560b816 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:25.955830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f70ed-c4cc-448d-bb0a-ce9ca560b816 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:25.957304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 23/50] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:25.963302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0871c-0c1e-4cff-aa15-b047a9b04a19 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:25.963588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0871c-0c1e-4cff-aa15-b047a9b04a19 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:25.963867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0871c-0c1e-4cff-aa15-b047a9b04a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:25.981391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a9e0871c-0c1e-4cff-aa15-b047a9b04a19 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:25.982618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a9e0871c-0c1e-4cff-aa15-b047a9b04a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:25.994767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:26.009134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1b63a-8d2b-4b98-aeab-1d77cc7ad7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.009814 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1b63a-8d2b-4b98-aeab-1d77cc7ad7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.010108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1b63a-8d2b-4b98-aeab-1d77cc7ad7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.010392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1b63a-8d2b-4b98-aeab-1d77cc7ad7e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.011142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1b63a-8d2b-4b98-aeab-1d77cc7ad7e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:26.011459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1b63a-8d2b-4b98-aeab-1d77cc7ad7e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.012878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1b63a-8d2b-4b98-aeab-1d77cc7ad7e0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.021356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 28/51] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:26.028536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1b63a-8d2b-4b98-aeab-1d77cc7ad7e0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:26.055328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 24/52] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:26.080165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0871c-0c1e-4cff-aa15-b047a9b04a19 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:26.089601 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:26.131567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1b63a-8d2b-4b98-aeab-1d77cc7ad7e0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.165953 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a586b7-5889-46a1-b665-d692829ab32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.167034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a586b7-5889-46a1-b665-d692829ab32a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.167312 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a586b7-5889-46a1-b665-d692829ab32a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.167586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a586b7-5889-46a1-b665-d692829ab32a None admin] PATH_INFO: `/v3/users/c3f241eb29634e3ba6cabbf8247be6c4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.168805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a586b7-5889-46a1-b665-d692829ab32a None admin] RBAC: Authorizing `identity:get_user(user_id=c3f241eb29634e3ba6cabbf8247be6c4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.170277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a586b7-5889-46a1-b665-d692829ab32a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.171892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 29/53] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:26 2022] GET /identity/v3/users/c3f241eb29634e3ba6cabbf8247be6c4 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:26.177247 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a586b7-5889-46a1-b665-d692829ab32a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:26.181949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0871c-0c1e-4cff-aa15-b047a9b04a19 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.215418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6d620-a75c-4b37-bae9-545439d165df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.216213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d620-a75c-4b37-bae9-545439d165df None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.216508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d620-a75c-4b37-bae9-545439d165df None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.216828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d620-a75c-4b37-bae9-545439d165df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.218032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6d620-a75c-4b37-bae9-545439d165df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.219511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6d620-a75c-4b37-bae9-545439d165df None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.221180 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 25/54] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:26.227072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6d620-a75c-4b37-bae9-545439d165df None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:26.243012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:26.277777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a586b7-5889-46a1-b665-d692829ab32a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.303740 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:26.313519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f1d3d-70ed-48b2-a713-41dd489b8a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.314314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f1d3d-70ed-48b2-a713-41dd489b8a4b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.314600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f1d3d-70ed-48b2-a713-41dd489b8a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.314879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f1d3d-70ed-48b2-a713-41dd489b8a4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.316060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f1d3d-70ed-48b2-a713-41dd489b8a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.317558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f1d3d-70ed-48b2-a713-41dd489b8a4b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.319168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 30/55] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:26.325013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f1d3d-70ed-48b2-a713-41dd489b8a4b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:26.327670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6d620-a75c-4b37-bae9-545439d165df None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.363591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ee074-f4ea-43f4-bdf4-b0e2db7eab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.364254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ee074-f4ea-43f4-bdf4-b0e2db7eab26 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.364545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ee074-f4ea-43f4-bdf4-b0e2db7eab26 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.364872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ee074-f4ea-43f4-bdf4-b0e2db7eab26 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.365593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ee074-f4ea-43f4-bdf4-b0e2db7eab26 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.367165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ee074-f4ea-43f4-bdf4-b0e2db7eab26 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.392538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 26/56] 10.222.0.40 () {60 vars in 1140 bytes} [Mon Jun 20 05:59:26 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:26.435450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f1d3d-70ed-48b2-a713-41dd489b8a4b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:26.471502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c565abc-5d57-4166-a8e0-634b12aeb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:26.472211 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565abc-5d57-4166-a8e0-634b12aeb613 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:26.472501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565abc-5d57-4166-a8e0-634b12aeb613 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:26.472811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565abc-5d57-4166-a8e0-634b12aeb613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:26.473671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c565abc-5d57-4166-a8e0-634b12aeb613 None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.domain.id=default, user.id=c3f241eb29634e3ba6cabbf8247be6c4) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:26.473990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c565abc-5d57-4166-a8e0-634b12aeb613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:26.475476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c565abc-5d57-4166-a8e0-634b12aeb613 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:26.485105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 31/57] 10.222.0.40 () {56 vars in 1322 bytes} [Mon Jun 20 05:59:26 2022] GET /identity/v3/role_assignments?user.id=c3f241eb29634e3ba6cabbf8247be6c4&scope.domain.id=default&role.id=efc16976111d431c9173186cbd0e6c24 => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:28.431015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166836b4-cd66-4771-9799-7283d2f79e29 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.431534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166836b4-cd66-4771-9799-7283d2f79e29 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.431618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166836b4-cd66-4771-9799-7283d2f79e29 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.433008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 27/58] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:28.438018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44aaff-c1e4-4cba-bb29-bd5728a2f40d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.438386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44aaff-c1e4-4cba-bb29-bd5728a2f40d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.438594 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44aaff-c1e4-4cba-bb29-bd5728a2f40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.455341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8e44aaff-c1e4-4cba-bb29-bd5728a2f40d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:28.456531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8e44aaff-c1e4-4cba-bb29-bd5728a2f40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:28.507969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:28.521382 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 32/59] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:28.546050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166836b4-cd66-4771-9799-7283d2f79e29 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.611930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:28.649347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166836b4-cd66-4771-9799-7283d2f79e29 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.682892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95757f-7c5a-4add-a571-6bba5d0b5f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:28.683632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95757f-7c5a-4add-a571-6bba5d0b5f94 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.683924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95757f-7c5a-4add-a571-6bba5d0b5f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.684209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95757f-7c5a-4add-a571-6bba5d0b5f94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.685421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95757f-7c5a-4add-a571-6bba5d0b5f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:28.686888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95757f-7c5a-4add-a571-6bba5d0b5f94 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:28.688496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 28/60] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:28.693963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44aaff-c1e4-4cba-bb29-bd5728a2f40d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.790115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44aaff-c1e4-4cba-bb29-bd5728a2f40d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.823103 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39c41b-fbdc-42a4-a7c7-7a1532322385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:28.823769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c41b-fbdc-42a4-a7c7-7a1532322385 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.824060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c41b-fbdc-42a4-a7c7-7a1532322385 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.824348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c41b-fbdc-42a4-a7c7-7a1532322385 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.825099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39c41b-fbdc-42a4-a7c7-7a1532322385 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:28.826554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39c41b-fbdc-42a4-a7c7-7a1532322385 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:28.851000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 33/61] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:28 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:32.009535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96017d0a-6b10-427c-8b90-fa9ff9f27540 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.010036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96017d0a-6b10-427c-8b90-fa9ff9f27540 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.010036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96017d0a-6b10-427c-8b90-fa9ff9f27540 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.011418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 29/62] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:32.016849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37070fbd-7f75-461b-8362-9ffd2803aef2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.017247 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37070fbd-7f75-461b-8362-9ffd2803aef2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.017432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37070fbd-7f75-461b-8362-9ffd2803aef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.041483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-37070fbd-7f75-461b-8362-9ffd2803aef2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:32.042703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-37070fbd-7f75-461b-8362-9ffd2803aef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:32.102275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:32.147244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 34/63] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:32.186346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96017d0a-6b10-427c-8b90-fa9ff9f27540 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:32.331008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96017d0a-6b10-427c-8b90-fa9ff9f27540 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:32.376161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ae5e7-f97f-4590-91dc-2db34c5a3856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:32.377003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ae5e7-f97f-4590-91dc-2db34c5a3856 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.377290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ae5e7-f97f-4590-91dc-2db34c5a3856 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.377571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ae5e7-f97f-4590-91dc-2db34c5a3856 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.380919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:32.387329 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d291ed-d1e4-4f1a-996a-75510c6d1bf9 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.387625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d291ed-d1e4-4f1a-996a-75510c6d1bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.387911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d291ed-d1e4-4f1a-996a-75510c6d1bf9 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.390380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 35/64] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:32.392580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ae5e7-f97f-4590-91dc-2db34c5a3856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:32.395648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaad41-178e-4e63-bb28-06c58fa76a44 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.395946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaad41-178e-4e63-bb28-06c58fa76a44 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.396235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaad41-178e-4e63-bb28-06c58fa76a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f56ae5e7-f97f-4590-91dc-2db34c5a3856 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:32.403414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:32.404288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:32.405114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 30/65] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:32.415626 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5bdbb-99ba-4a01-9aa2-f595d576fcac None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.415912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5bdbb-99ba-4a01-9aa2-f595d576fcac None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.416195 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5bdbb-99ba-4a01-9aa2-f595d576fcac None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.417590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 31/66] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:32.421285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5bdbb-99ba-4a01-9aa2-f595d576fcac None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:32.425991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d5aaad41-178e-4e63-bb28-06c58fa76a44 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:32.427398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d5aaad41-178e-4e63-bb28-06c58fa76a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:32.501199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 36/67] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:32.505645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95f955-6af6-4a94-a56a-90c26a2d958b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.505645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95f955-6af6-4a94-a56a-90c26a2d958b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.505645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95f955-6af6-4a94-a56a-90c26a2d958b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.527488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ad95f955-6af6-4a94-a56a-90c26a2d958b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:32.528872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ad95f955-6af6-4a94-a56a-90c26a2d958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:32.541316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5bdbb-99ba-4a01-9aa2-f595d576fcac None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:32.576355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d441d93-1c9b-47fa-9b9c-4f9ece798850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:32.577066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d441d93-1c9b-47fa-9b9c-4f9ece798850 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.577364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d441d93-1c9b-47fa-9b9c-4f9ece798850 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.577651 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d441d93-1c9b-47fa-9b9c-4f9ece798850 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.578415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d441d93-1c9b-47fa-9b9c-4f9ece798850 None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:32.578737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d441d93-1c9b-47fa-9b9c-4f9ece798850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:32.580135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d441d93-1c9b-47fa-9b9c-4f9ece798850 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:32.589033 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 32/68] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:32.590410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5429-1827-44ae-987b-675122290f5e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.590709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5429-1827-44ae-987b-675122290f5e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.590992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5429-1827-44ae-987b-675122290f5e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.592228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 33/69] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:32.592971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b5429-1827-44ae-987b-675122290f5e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:32.605539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 37/70] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:32.606858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968efff0-3e70-4fd8-9899-774e7c6f475e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.607152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968efff0-3e70-4fd8-9899-774e7c6f475e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.607435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968efff0-3e70-4fd8-9899-774e7c6f475e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.608737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 38/71] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:32.609438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968efff0-3e70-4fd8-9899-774e7c6f475e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:32.650377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:32.667241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:32.711342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b5429-1827-44ae-987b-675122290f5e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:32.717659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968efff0-3e70-4fd8-9899-774e7c6f475e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:32.746202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7e73c-f198-4fd8-95d2-65e87e5b029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:32.746992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7e73c-f198-4fd8-95d2-65e87e5b029e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.747276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7e73c-f198-4fd8-95d2-65e87e5b029e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.747553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7e73c-f198-4fd8-95d2-65e87e5b029e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.753230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed41e11-a353-411a-a26e-12aa29203536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:32.754108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41e11-a353-411a-a26e-12aa29203536 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.754393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41e11-a353-411a-a26e-12aa29203536 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.754669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41e11-a353-411a-a26e-12aa29203536 None admin] PATH_INFO: `/v3/users/5b5a1eff07f9401787ed37895a56aafd` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.758082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7e73c-f198-4fd8-95d2-65e87e5b029e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-fbd7e73c-f198-4fd8-95d2-65e87e5b029e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:32.765976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:32.767021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:32.767973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 34/72] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:32.768774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df107a-deea-4d21-9cb4-b38bb4fcc48e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.768774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df107a-deea-4d21-9cb4-b38bb4fcc48e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.769086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df107a-deea-4d21-9cb4-b38bb4fcc48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.771777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed41e11-a353-411a-a26e-12aa29203536 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5a1eff07f9401787ed37895a56aafd)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:32.773603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed41e11-a353-411a-a26e-12aa29203536 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:32.775310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 39/73] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:32 2022] GET /identity/v3/users/5b5a1eff07f9401787ed37895a56aafd => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:32.776494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46ce1a-1e17-4bf9-969d-e3a38496b673 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:32.776819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46ce1a-1e17-4bf9-969d-e3a38496b673 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:32.777103 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46ce1a-1e17-4bf9-969d-e3a38496b673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:32.786532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-48df107a-deea-4d21-9cb4-b38bb4fcc48e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:32.787712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-48df107a-deea-4d21-9cb4-b38bb4fcc48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:32.793631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2c46ce1a-1e17-4bf9-969d-e3a38496b673 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:32.794803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2c46ce1a-1e17-4bf9-969d-e3a38496b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:32.855239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 35/74] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:32.856006 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df107a-deea-4d21-9cb4-b38bb4fcc48e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:32.860885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 40/75] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:32.861707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46ce1a-1e17-4bf9-969d-e3a38496b673 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:32.888929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:32.918019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:32.967228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46ce1a-1e17-4bf9-969d-e3a38496b673 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:32.971526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df107a-deea-4d21-9cb4-b38bb4fcc48e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.001802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02955d8-b0e5-48c9-97b2-cb51144b207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.002471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02955d8-b0e5-48c9-97b2-cb51144b207f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.002762 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02955d8-b0e5-48c9-97b2-cb51144b207f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.003045 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02955d8-b0e5-48c9-97b2-cb51144b207f None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.003794 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02955d8-b0e5-48c9-97b2-cb51144b207f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:33.004108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02955d8-b0e5-48c9-97b2-cb51144b207f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:33.005550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02955d8-b0e5-48c9-97b2-cb51144b207f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:33.012968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3426b-1770-4116-926c-8b7a231856c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.013897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3426b-1770-4116-926c-8b7a231856c8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.014199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3426b-1770-4116-926c-8b7a231856c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.014288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 41/76] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:33.014489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3426b-1770-4116-926c-8b7a231856c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.014993 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02955d8-b0e5-48c9-97b2-cb51144b207f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.025733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3426b-1770-4116-926c-8b7a231856c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f7f3426b-1770-4116-926c-8b7a231856c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:33.033930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:33.035072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:33.035935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 36/77] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 05:59:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:33.036567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3426b-1770-4116-926c-8b7a231856c8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.104236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:33.121606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02955d8-b0e5-48c9-97b2-cb51144b207f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.138911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3426b-1770-4116-926c-8b7a231856c8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.145831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:33.155140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c23cb-ffeb-425b-b211-2df63de3eeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.155796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c23cb-ffeb-425b-b211-2df63de3eeab None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.156080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c23cb-ffeb-425b-b211-2df63de3eeab None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.156362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c23cb-ffeb-425b-b211-2df63de3eeab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.174307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a1ef9-4909-4e38-a0cc-6b7eb26cb6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.175100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a1ef9-4909-4e38-a0cc-6b7eb26cb6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.175388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a1ef9-4909-4e38-a0cc-6b7eb26cb6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.175669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a1ef9-4909-4e38-a0cc-6b7eb26cb6d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.186436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a1ef9-4909-4e38-a0cc-6b7eb26cb6d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-c81a1ef9-4909-4e38-a0cc-6b7eb26cb6d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:33.194164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:33.195789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:33.196639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 37/78] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:33.197286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a1ef9-4909-4e38-a0cc-6b7eb26cb6d9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.226347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c23cb-ffeb-425b-b211-2df63de3eeab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:33.227806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c23cb-ffeb-425b-b211-2df63de3eeab None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:33.301259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a1ef9-4909-4e38-a0cc-6b7eb26cb6d9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.310015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:33.327240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 42/79] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:59:33.332501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c23cb-ffeb-425b-b211-2df63de3eeab None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.336838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e0e43-904e-4f4f-ba2c-0a1062165d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.337677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0e43-904e-4f4f-ba2c-0a1062165d89 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.337968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0e43-904e-4f4f-ba2c-0a1062165d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.338254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0e43-904e-4f4f-ba2c-0a1062165d89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.339485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0e43-904e-4f4f-ba2c-0a1062165d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:33.341058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0e43-904e-4f4f-ba2c-0a1062165d89 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:33.342676 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 38/80] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:33.343442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e0e43-904e-4f4f-ba2c-0a1062165d89 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.378211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:33.431538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c23cb-ffeb-425b-b211-2df63de3eeab None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.445430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e0e43-904e-4f4f-ba2c-0a1062165d89 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.466695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be279be3-41b7-4cb4-b503-35b744c8d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.467564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be279be3-41b7-4cb4-b503-35b744c8d2fc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.467850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be279be3-41b7-4cb4-b503-35b744c8d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.468126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be279be3-41b7-4cb4-b503-35b744c8d2fc None admin] PATH_INFO: `/v3/users/c3f241eb29634e3ba6cabbf8247be6c4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.469324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be279be3-41b7-4cb4-b503-35b744c8d2fc None admin] RBAC: Authorizing `identity:get_user(user_id=c3f241eb29634e3ba6cabbf8247be6c4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:33.470773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be279be3-41b7-4cb4-b503-35b744c8d2fc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:33.472387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 43/81] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/users/c3f241eb29634e3ba6cabbf8247be6c4 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:33.473174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be279be3-41b7-4cb4-b503-35b744c8d2fc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.481114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd034f1-e1e6-44e1-8953-bd030309624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.481794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd034f1-e1e6-44e1-8953-bd030309624e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.482090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd034f1-e1e6-44e1-8953-bd030309624e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.482375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd034f1-e1e6-44e1-8953-bd030309624e None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.483141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd034f1-e1e6-44e1-8953-bd030309624e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:33.483458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd034f1-e1e6-44e1-8953-bd030309624e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:33.484888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd034f1-e1e6-44e1-8953-bd030309624e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:33.497998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 39/82] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:33.497998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd034f1-e1e6-44e1-8953-bd030309624e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.526165 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:33.574375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be279be3-41b7-4cb4-b503-35b744c8d2fc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.590838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:33.597451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd034f1-e1e6-44e1-8953-bd030309624e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.609694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacee83-76f9-4d18-8367-c627a3811305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.610364 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacee83-76f9-4d18-8367-c627a3811305 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.610656 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacee83-76f9-4d18-8367-c627a3811305 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.610939 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacee83-76f9-4d18-8367-c627a3811305 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.611697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacee83-76f9-4d18-8367-c627a3811305 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:33.612009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacee83-76f9-4d18-8367-c627a3811305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:33.613451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacee83-76f9-4d18-8367-c627a3811305 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:33.621959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 44/83] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:33.622768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacee83-76f9-4d18-8367-c627a3811305 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.635437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d491de6-e88f-4556-9b5f-df38df992456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.636250 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d491de6-e88f-4556-9b5f-df38df992456 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.636543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d491de6-e88f-4556-9b5f-df38df992456 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.636860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d491de6-e88f-4556-9b5f-df38df992456 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.638091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d491de6-e88f-4556-9b5f-df38df992456 None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:33.639580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d491de6-e88f-4556-9b5f-df38df992456 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:33.641325 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 40/84] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:33.642092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d491de6-e88f-4556-9b5f-df38df992456 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.730679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacee83-76f9-4d18-8367-c627a3811305 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.743108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d491de6-e88f-4556-9b5f-df38df992456 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.743851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:33.764537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdce5b-715c-402d-b0f2-09e7afdd1d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.765233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdce5b-715c-402d-b0f2-09e7afdd1d4d None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.765523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdce5b-715c-402d-b0f2-09e7afdd1d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.765806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdce5b-715c-402d-b0f2-09e7afdd1d4d None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.766527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdce5b-715c-402d-b0f2-09e7afdd1d4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:33.767986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdce5b-715c-402d-b0f2-09e7afdd1d4d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:33.778103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728e7cb-5e56-42e3-8e53-1974a7ce3eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.778762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728e7cb-5e56-42e3-8e53-1974a7ce3eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.779123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728e7cb-5e56-42e3-8e53-1974a7ce3eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.779439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728e7cb-5e56-42e3-8e53-1974a7ce3eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.788076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 45/85] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:33 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:33.800919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdce5b-715c-402d-b0f2-09e7afdd1d4d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.814491 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:33.859239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728e7cb-5e56-42e3-8e53-1974a7ce3eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:33.860831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728e7cb-5e56-42e3-8e53-1974a7ce3eb4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:33.917278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdce5b-715c-402d-b0f2-09e7afdd1d4d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.961815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4975fe5-7591-4d21-bf64-8886d73262d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.962710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4975fe5-7591-4d21-bf64-8886d73262d2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.963445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4975fe5-7591-4d21-bf64-8886d73262d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.963739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4975fe5-7591-4d21-bf64-8886d73262d2 None admin] PATH_INFO: `/v3/users/5b5a1eff07f9401787ed37895a56aafd` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.965206 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4975fe5-7591-4d21-bf64-8886d73262d2 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5a1eff07f9401787ed37895a56aafd)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:33.966691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4975fe5-7591-4d21-bf64-8886d73262d2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:33.968403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 46/86] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/users/5b5a1eff07f9401787ed37895a56aafd => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:33.969208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4975fe5-7591-4d21-bf64-8886d73262d2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.984641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 41/87] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:59:33.985883 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728e7cb-5e56-42e3-8e53-1974a7ce3eb4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.019109 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.071167 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.100540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4975fe5-7591-4d21-bf64-8886d73262d2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.115619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728e7cb-5e56-42e3-8e53-1974a7ce3eb4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.138513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df111c58-ea33-4f3b-8b97-4689e1ed10d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.139504 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df111c58-ea33-4f3b-8b97-4689e1ed10d5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.139859 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df111c58-ea33-4f3b-8b97-4689e1ed10d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.140209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df111c58-ea33-4f3b-8b97-4689e1ed10d5 None admin] PATH_INFO: `/v3/users/5b5a1eff07f9401787ed37895a56aafd` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.142441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df111c58-ea33-4f3b-8b97-4689e1ed10d5 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5a1eff07f9401787ed37895a56aafd)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.143907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df111c58-ea33-4f3b-8b97-4689e1ed10d5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.145766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 47/88] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/users/5b5a1eff07f9401787ed37895a56aafd => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:34.146446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df111c58-ea33-4f3b-8b97-4689e1ed10d5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.165363 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d275ab7-384c-42cd-b807-ae15997540e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.167030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d275ab7-384c-42cd-b807-ae15997540e0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.167592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d275ab7-384c-42cd-b807-ae15997540e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.168233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d275ab7-384c-42cd-b807-ae15997540e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.169636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d275ab7-384c-42cd-b807-ae15997540e0 None admin] RBAC: Adding query filter params (role.id=f5a5bdf6fee0438391dd54c5b545305e, scope.project.id=9f140c317e2e4605b3c3ef8420147900, user.id=5b5a1eff07f9401787ed37895a56aafd) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:34.170180 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d275ab7-384c-42cd-b807-ae15997540e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.172290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d275ab7-384c-42cd-b807-ae15997540e0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.181102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 42/89] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/role_assignments?user.id=5b5a1eff07f9401787ed37895a56aafd&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:34.182186 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d275ab7-384c-42cd-b807-ae15997540e0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.321912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d275ab7-384c-42cd-b807-ae15997540e0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.334877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df111c58-ea33-4f3b-8b97-4689e1ed10d5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.343320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.376036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9049c89-f449-4fb1-a20a-278f8c67bd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.376787 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9049c89-f449-4fb1-a20a-278f8c67bd45 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.377079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9049c89-f449-4fb1-a20a-278f8c67bd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.377360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9049c89-f449-4fb1-a20a-278f8c67bd45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.392106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.404954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cbea0-0db9-4d75-b8a3-a295c3132da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.405894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbea0-0db9-4d75-b8a3-a295c3132da1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.406184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbea0-0db9-4d75-b8a3-a295c3132da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.406472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbea0-0db9-4d75-b8a3-a295c3132da1 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.407873 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cbea0-0db9-4d75-b8a3-a295c3132da1 None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.409707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cbea0-0db9-4d75-b8a3-a295c3132da1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.411956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 43/90] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:34.412372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cbea0-0db9-4d75-b8a3-a295c3132da1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.460935 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9049c89-f449-4fb1-a20a-278f8c67bd45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.462766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9049c89-f449-4fb1-a20a-278f8c67bd45 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.528999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cbea0-0db9-4d75-b8a3-a295c3132da1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.566992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 48/91] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:59:34.567168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7762bf7-5253-4b1e-89e1-adc81259113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.567827 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7762bf7-5253-4b1e-89e1-adc81259113b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.568119 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7762bf7-5253-4b1e-89e1-adc81259113b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.568405 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7762bf7-5253-4b1e-89e1-adc81259113b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.573164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9049c89-f449-4fb1-a20a-278f8c67bd45 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.582383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.643350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.652469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7762bf7-5253-4b1e-89e1-adc81259113b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.654103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7762bf7-5253-4b1e-89e1-adc81259113b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.680126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9049c89-f449-4fb1-a20a-278f8c67bd45 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.716209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb34e7-3baa-454a-923f-4d61b7e34b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.716842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb34e7-3baa-454a-923f-4d61b7e34b3f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.717133 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb34e7-3baa-454a-923f-4d61b7e34b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.717416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb34e7-3baa-454a-923f-4d61b7e34b3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.718396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb34e7-3baa-454a-923f-4d61b7e34b3f None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=9f140c317e2e4605b3c3ef8420147900, user.id=c3f241eb29634e3ba6cabbf8247be6c4) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:34.718714 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb34e7-3baa-454a-923f-4d61b7e34b3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.720181 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb34e7-3baa-454a-923f-4d61b7e34b3f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.726236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 49/92] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/role_assignments?user.id=c3f241eb29634e3ba6cabbf8247be6c4&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=efc16976111d431c9173186cbd0e6c24 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:34.727059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb34e7-3baa-454a-923f-4d61b7e34b3f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.770407 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 44/93] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:59:34.777483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7762bf7-5253-4b1e-89e1-adc81259113b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.804094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.839728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb34e7-3baa-454a-923f-4d61b7e34b3f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.876168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d422cb-2cf4-41e4-9f5b-7c5417213465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.877184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d422cb-2cf4-41e4-9f5b-7c5417213465 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.877547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d422cb-2cf4-41e4-9f5b-7c5417213465 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.877906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d422cb-2cf4-41e4-9f5b-7c5417213465 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.879210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d422cb-2cf4-41e4-9f5b-7c5417213465 None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.880806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d422cb-2cf4-41e4-9f5b-7c5417213465 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.883197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 50/94] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:34.888811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d422cb-2cf4-41e4-9f5b-7c5417213465 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:34.889168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:34.896338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7762bf7-5253-4b1e-89e1-adc81259113b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:34.939204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaed5c-21c7-42c0-b6d7-3674dd7a1672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:34.940212 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaed5c-21c7-42c0-b6d7-3674dd7a1672 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:34.940510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaed5c-21c7-42c0-b6d7-3674dd7a1672 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:34.940872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaed5c-21c7-42c0-b6d7-3674dd7a1672 None admin] PATH_INFO: `/v3/projects/8d083244ce3044329a5b69289fac999d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:34.942262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaed5c-21c7-42c0-b6d7-3674dd7a1672 None admin] RBAC: Authorizing `identity:get_project(project_id=8d083244ce3044329a5b69289fac999d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:34.943944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaed5c-21c7-42c0-b6d7-3674dd7a1672 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:34.946332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 45/95] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/projects/8d083244ce3044329a5b69289fac999d => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:34.952188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaed5c-21c7-42c0-b6d7-3674dd7a1672 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:35.003224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d422cb-2cf4-41e4-9f5b-7c5417213465 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:35.041040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a8a18-6dd3-40a9-9fa1-5ee7f4920171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:35.042075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a8a18-6dd3-40a9-9fa1-5ee7f4920171 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:35.042559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a8a18-6dd3-40a9-9fa1-5ee7f4920171 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:35.043050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a8a18-6dd3-40a9-9fa1-5ee7f4920171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:35.044079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a8a18-6dd3-40a9-9fa1-5ee7f4920171 None admin] RBAC: Adding query filter params (role.id=0af0bb9954e74b6c9158c0ea76a2c7a5, scope.project.id=9f140c317e2e4605b3c3ef8420147900, user.id=5b5a1eff07f9401787ed37895a56aafd) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:35.044603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a8a18-6dd3-40a9-9fa1-5ee7f4920171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:35.046282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a8a18-6dd3-40a9-9fa1-5ee7f4920171 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:35.052313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 51/96] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/role_assignments?user.id=5b5a1eff07f9401787ed37895a56aafd&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:35.070815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaed5c-21c7-42c0-b6d7-3674dd7a1672 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:35.110981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713892d-7d5f-4167-93e7-e056d2295c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:35.111744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713892d-7d5f-4167-93e7-e056d2295c37 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:35.111949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713892d-7d5f-4167-93e7-e056d2295c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:35.112234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713892d-7d5f-4167-93e7-e056d2295c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:35.113125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713892d-7d5f-4167-93e7-e056d2295c37 None admin] RBAC: Adding query filter params (role.id=f5a5bdf6fee0438391dd54c5b545305e, scope.project.id=8d083244ce3044329a5b69289fac999d, user.id=5b5a1eff07f9401787ed37895a56aafd) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:35.113451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713892d-7d5f-4167-93e7-e056d2295c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:35.115030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713892d-7d5f-4167-93e7-e056d2295c37 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:35.122880 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 46/97] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:34 2022] GET /identity/v3/role_assignments?user.id=5b5a1eff07f9401787ed37895a56aafd&scope.project.id=8d083244ce3044329a5b69289fac999d&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:36.946076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f67c6-ce1e-40f5-a331-e8f308567258 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:36.947083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f67c6-ce1e-40f5-a331-e8f308567258 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:36.947580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f67c6-ce1e-40f5-a331-e8f308567258 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:36.949213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 52/98] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:36.954829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486618-7017-42f7-a3b5-e511a97c37bb None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:36.955734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486618-7017-42f7-a3b5-e511a97c37bb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:36.956265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486618-7017-42f7-a3b5-e511a97c37bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:36.980143 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-65486618-7017-42f7-a3b5-e511a97c37bb None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:36.981692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-65486618-7017-42f7-a3b5-e511a97c37bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:37.011705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:37.081982 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 47/99] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:37.130120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f67c6-ce1e-40f5-a331-e8f308567258 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:37.133722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:37.178902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98161d-88c1-4030-adb1-392d56407db8 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.179543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98161d-88c1-4030-adb1-392d56407db8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.180022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98161d-88c1-4030-adb1-392d56407db8 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.181851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 48/100] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:37.187127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589433-6e9c-43fc-a9c1-54114ff574b3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.187656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589433-6e9c-43fc-a9c1-54114ff574b3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.188132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589433-6e9c-43fc-a9c1-54114ff574b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.229874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6c589433-6e9c-43fc-a9c1-54114ff574b3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:37.231485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6c589433-6e9c-43fc-a9c1-54114ff574b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:37.293319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f67c6-ce1e-40f5-a331-e8f308567258 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:37.349409 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc5059-4ef6-4537-bad2-e376f09cf6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:37.350810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc5059-4ef6-4537-bad2-e376f09cf6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.351130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc5059-4ef6-4537-bad2-e376f09cf6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.351414 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc5059-4ef6-4537-bad2-e376f09cf6f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.367978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc5059-4ef6-4537-bad2-e376f09cf6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b8bc5059-4ef6-4537-bad2-e376f09cf6f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:37.382210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:37.383263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:37.384037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 53/101] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:37.389310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc5059-4ef6-4537-bad2-e376f09cf6f0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:37.416046 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 49/102] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:37.426618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01748-6fd9-4858-b345-c49acdf6f1c8 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.427091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01748-6fd9-4858-b345-c49acdf6f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.427509 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01748-6fd9-4858-b345-c49acdf6f1c8 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.429573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 50/103] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:37.434762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941cd73-bd8b-4c54-a606-1532b1ba34c7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.435239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941cd73-bd8b-4c54-a606-1532b1ba34c7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.435660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941cd73-bd8b-4c54-a606-1532b1ba34c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.456092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2941cd73-bd8b-4c54-a606-1532b1ba34c7 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:37.457785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2941cd73-bd8b-4c54-a606-1532b1ba34c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:37.547897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 51/104] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:37.554008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941cd73-bd8b-4c54-a606-1532b1ba34c7 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:37.558230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:37.581489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:37.643701 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc5059-4ef6-4537-bad2-e376f09cf6f0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:37.682483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d35e8-b79e-4efb-850b-1f171788f2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:37.683572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d35e8-b79e-4efb-850b-1f171788f2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.684007 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d35e8-b79e-4efb-850b-1f171788f2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.684432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d35e8-b79e-4efb-850b-1f171788f2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.685371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d35e8-b79e-4efb-850b-1f171788f2c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:37.685838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d35e8-b79e-4efb-850b-1f171788f2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:37.687386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d35e8-b79e-4efb-850b-1f171788f2c8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:37.696639 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 54/105] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:37.697838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d35e8-b79e-4efb-850b-1f171788f2c8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:37.716721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941cd73-bd8b-4c54-a606-1532b1ba34c7 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:37.783490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01cc37-8cd4-47ef-be84-8f5f3822bbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:37.785452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01cc37-8cd4-47ef-be84-8f5f3822bbcb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.791203 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01cc37-8cd4-47ef-be84-8f5f3822bbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.791666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01cc37-8cd4-47ef-be84-8f5f3822bbcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.809002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01cc37-8cd4-47ef-be84-8f5f3822bbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ca01cc37-8cd4-47ef-be84-8f5f3822bbcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:37.816564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:37.817734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 52/106] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:37.818729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01cc37-8cd4-47ef-be84-8f5f3822bbcb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:37.837903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d35e8-b79e-4efb-850b-1f171788f2c8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:37.866192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:37.878514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450969b2-90a9-4a70-9314-87e8da1ebb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:37.879332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450969b2-90a9-4a70-9314-87e8da1ebb46 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.879623 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450969b2-90a9-4a70-9314-87e8da1ebb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.879910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450969b2-90a9-4a70-9314-87e8da1ebb46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.881127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450969b2-90a9-4a70-9314-87e8da1ebb46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:37.882697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450969b2-90a9-4a70-9314-87e8da1ebb46 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:37.884338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 55/107] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:37.885566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25bf16-6028-4d09-8e28-b76fffe13251 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.885858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25bf16-6028-4d09-8e28-b76fffe13251 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.886142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25bf16-6028-4d09-8e28-b76fffe13251 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.887543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 56/108] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:37.888098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25bf16-6028-4d09-8e28-b76fffe13251 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:37.919926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:37.944938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01cc37-8cd4-47ef-be84-8f5f3822bbcb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:37.980805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948061a-820f-4a43-84e9-e5e20f9fd0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:37.981690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948061a-820f-4a43-84e9-e5e20f9fd0cd None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:37.981981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948061a-820f-4a43-84e9-e5e20f9fd0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:37.982272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948061a-820f-4a43-84e9-e5e20f9fd0cd None admin] PATH_INFO: `/v3/users/3a97abd494c449669359c9f2360faab6` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:37.999070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948061a-820f-4a43-84e9-e5e20f9fd0cd None admin] RBAC: Authorizing `identity:get_user(user_id=3a97abd494c449669359c9f2360faab6)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:37.999405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25bf16-6028-4d09-8e28-b76fffe13251 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:38.000567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948061a-820f-4a43-84e9-e5e20f9fd0cd None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:38.002312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 53/109] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:37 2022] GET /identity/v3/users/3a97abd494c449669359c9f2360faab6 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:38.003552 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636856-66f1-4bb3-bffe-02d19d2e0385 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.003847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636856-66f1-4bb3-bffe-02d19d2e0385 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.004132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636856-66f1-4bb3-bffe-02d19d2e0385 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.005586 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 54/110] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:38.010601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06636856-66f1-4bb3-bffe-02d19d2e0385 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.041256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eea4f9-fdad-4a75-b164-739366fa9471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:38.041926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eea4f9-fdad-4a75-b164-739366fa9471 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.042213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eea4f9-fdad-4a75-b164-739366fa9471 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.042486 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eea4f9-fdad-4a75-b164-739366fa9471 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.043228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eea4f9-fdad-4a75-b164-739366fa9471 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:38.043533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eea4f9-fdad-4a75-b164-739366fa9471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:38.044952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eea4f9-fdad-4a75-b164-739366fa9471 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:38.053175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 57/111] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:38.054564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e067-9697-4248-9f62-afdc0a823899 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.054861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e067-9697-4248-9f62-afdc0a823899 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.055141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e067-9697-4248-9f62-afdc0a823899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.071613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ef22e067-9697-4248-9f62-afdc0a823899 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:38.072749 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ef22e067-9697-4248-9f62-afdc0a823899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:38.121275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06636856-66f1-4bb3-bffe-02d19d2e0385 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:38.128370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:38.148748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 58/112] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:38.152886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22e067-9697-4248-9f62-afdc0a823899 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.163385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85091a-5c9c-4dc8-884a-89e28897b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:38.164741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85091a-5c9c-4dc8-884a-89e28897b7d5 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.165193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85091a-5c9c-4dc8-884a-89e28897b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.165729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85091a-5c9c-4dc8-884a-89e28897b7d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.166736 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85091a-5c9c-4dc8-884a-89e28897b7d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:38.168454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85091a-5c9c-4dc8-884a-89e28897b7d5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:38.173496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:38.206014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 55/113] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 05:59:38 2022] POST /identity/v3/projects => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:38.206014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da09818-73a0-405d-8be9-8a09023ae0e4 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.206014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da09818-73a0-405d-8be9-8a09023ae0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.206014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da09818-73a0-405d-8be9-8a09023ae0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.224035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2da09818-73a0-405d-8be9-8a09023ae0e4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:38.225356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2da09818-73a0-405d-8be9-8a09023ae0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:38.286801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22e067-9697-4248-9f62-afdc0a823899 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:38.309272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 56/114] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:38.310370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da09818-73a0-405d-8be9-8a09023ae0e4 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.337828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff425b-5cdb-447d-94bb-0e2cba0ed3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:38.338861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff425b-5cdb-447d-94bb-0e2cba0ed3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.339220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff425b-5cdb-447d-94bb-0e2cba0ed3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.339505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff425b-5cdb-447d-94bb-0e2cba0ed3f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.396998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:38.415936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff425b-5cdb-447d-94bb-0e2cba0ed3f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:38.417444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff425b-5cdb-447d-94bb-0e2cba0ed3f0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:38.432420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da09818-73a0-405d-8be9-8a09023ae0e4 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:38.450627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:38.472406 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c27a7-8047-4b51-a33a-3baf1ad23ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:38.473439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c27a7-8047-4b51-a33a-3baf1ad23ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.473731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c27a7-8047-4b51-a33a-3baf1ad23ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.474014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c27a7-8047-4b51-a33a-3baf1ad23ec7 None admin] PATH_INFO: `/v3/users/5b5a1eff07f9401787ed37895a56aafd` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.475782 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c27a7-8047-4b51-a33a-3baf1ad23ec7 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5a1eff07f9401787ed37895a56aafd)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:38.477719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c27a7-8047-4b51-a33a-3baf1ad23ec7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:38.483749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 57/115] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:38 2022] GET /identity/v3/users/5b5a1eff07f9401787ed37895a56aafd => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:38.483749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c27a7-8047-4b51-a33a-3baf1ad23ec7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.529720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 59/116] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:59:38.531031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dac97f-b525-426a-bf05-abcab8a93343 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.531332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dac97f-b525-426a-bf05-abcab8a93343 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.531615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dac97f-b525-426a-bf05-abcab8a93343 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.534539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 60/117] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:38.534539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dac97f-b525-426a-bf05-abcab8a93343 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.595411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c27a7-8047-4b51-a33a-3baf1ad23ec7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:38.634035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:38.641244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec5dcf-969e-40e2-92a9-04bce85d5e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:38.642073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec5dcf-969e-40e2-92a9-04bce85d5e3b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.642619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec5dcf-969e-40e2-92a9-04bce85d5e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.642619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec5dcf-969e-40e2-92a9-04bce85d5e3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.653705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec5dcf-969e-40e2-92a9-04bce85d5e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:38.654252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dac97f-b525-426a-bf05-abcab8a93343 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1dec5dcf-969e-40e2-92a9-04bce85d5e3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:38.662170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:38.663360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 58/118] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 05:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:38.664381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec5dcf-969e-40e2-92a9-04bce85d5e3b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.690999 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93609d08-01fa-4e8c-aa9f-3bf7c6d197dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:38.691838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93609d08-01fa-4e8c-aa9f-3bf7c6d197dd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.692130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93609d08-01fa-4e8c-aa9f-3bf7c6d197dd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.692888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93609d08-01fa-4e8c-aa9f-3bf7c6d197dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.704202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93609d08-01fa-4e8c-aa9f-3bf7c6d197dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-93609d08-01fa-4e8c-aa9f-3bf7c6d197dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:38.712022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:38.712955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 61/119] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:38.718744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93609d08-01fa-4e8c-aa9f-3bf7c6d197dd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.728063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:38.787399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec5dcf-969e-40e2-92a9-04bce85d5e3b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:38.822367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5b906-a910-4c73-89cc-94816323aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:38.823242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b906-a910-4c73-89cc-94816323aff3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.823551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b906-a910-4c73-89cc-94816323aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.823819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b906-a910-4c73-89cc-94816323aff3 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.825336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b906-a910-4c73-89cc-94816323aff3 None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:38.826833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b906-a910-4c73-89cc-94816323aff3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:38.827325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93609d08-01fa-4e8c-aa9f-3bf7c6d197dd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:38.828562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 59/120] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:38 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:38.829724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7643-1805-431a-9638-3924dbfef119 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.830019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7643-1805-431a-9638-3924dbfef119 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.830303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7643-1805-431a-9638-3924dbfef119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.847372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-519e7643-1805-431a-9638-3924dbfef119 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:38.848505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-519e7643-1805-431a-9638-3924dbfef119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:38.870455 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7540d-d6ae-49b8-8f75-8cc50185adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:38.871706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7540d-d6ae-49b8-8f75-8cc50185adc4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.872266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7540d-d6ae-49b8-8f75-8cc50185adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.872736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7540d-d6ae-49b8-8f75-8cc50185adc4 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.874214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7540d-d6ae-49b8-8f75-8cc50185adc4 None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:38.875976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7540d-d6ae-49b8-8f75-8cc50185adc4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:38.883033 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 62/121] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:38 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:38.884079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7540d-d6ae-49b8-8f75-8cc50185adc4 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.902940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:38.920854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 60/122] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:38.921927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e7643-1805-431a-9638-3924dbfef119 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.969507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:39.013930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7540d-d6ae-49b8-8f75-8cc50185adc4 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:39.029261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e7643-1805-431a-9638-3924dbfef119 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:39.050333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2e61-bee6-4fe2-a10b-812e1688be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:39.051013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2e61-bee6-4fe2-a10b-812e1688be4a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.051302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2e61-bee6-4fe2-a10b-812e1688be4a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.051582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2e61-bee6-4fe2-a10b-812e1688be4a None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.052328 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2e61-bee6-4fe2-a10b-812e1688be4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:39.052695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2e61-bee6-4fe2-a10b-812e1688be4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:39.054594 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2e61-bee6-4fe2-a10b-812e1688be4a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:39.062881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 63/123] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:39.063629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2e61-bee6-4fe2-a10b-812e1688be4a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:39.072935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d36dd-df87-4b0a-8ad4-6decd9656425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:39.073624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d36dd-df87-4b0a-8ad4-6decd9656425 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.073913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d36dd-df87-4b0a-8ad4-6decd9656425 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.074443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d36dd-df87-4b0a-8ad4-6decd9656425 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.074962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d36dd-df87-4b0a-8ad4-6decd9656425 None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:39.075277 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d36dd-df87-4b0a-8ad4-6decd9656425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:39.076724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d36dd-df87-4b0a-8ad4-6decd9656425 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:39.085962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 61/124] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:39.090975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d36dd-df87-4b0a-8ad4-6decd9656425 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:39.143841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:39.170576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2e61-bee6-4fe2-a10b-812e1688be4a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:39.195516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d36dd-df87-4b0a-8ad4-6decd9656425 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:39.203565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:39.206464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0fe88-5287-411d-bb25-87d5c3087e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:39.207359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0fe88-5287-411d-bb25-87d5c3087e6b None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.207646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0fe88-5287-411d-bb25-87d5c3087e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.207987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0fe88-5287-411d-bb25-87d5c3087e6b None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900/users/5b5a1eff07f9401787ed37895a56aafd/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.211212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0fe88-5287-411d-bb25-87d5c3087e6b None admin] RBAC: Authorizing `identity:create_grant(project_id=9f140c317e2e4605b3c3ef8420147900, user_id=5b5a1eff07f9401787ed37895a56aafd, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:39.213719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0fe88-5287-411d-bb25-87d5c3087e6b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:39.229996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 64/125] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:39 2022] PUT /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900/users/5b5a1eff07f9401787ed37895a56aafd/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:39.237461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0fe88-5287-411d-bb25-87d5c3087e6b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:39.245511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873c07e-bf90-4277-bcf9-9b52a23ab140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:39.246611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873c07e-bf90-4277-bcf9-9b52a23ab140 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.246920 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873c07e-bf90-4277-bcf9-9b52a23ab140 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.247276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873c07e-bf90-4277-bcf9-9b52a23ab140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.248232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873c07e-bf90-4277-bcf9-9b52a23ab140 None admin] RBAC: Adding query filter params (role.id=bee6c92a21d64b28b852f8719be02e65, scope.project.id=9f140c317e2e4605b3c3ef8420147900, user.id=3a97abd494c449669359c9f2360faab6) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:39.248662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873c07e-bf90-4277-bcf9-9b52a23ab140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:39.250747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873c07e-bf90-4277-bcf9-9b52a23ab140 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:39.265098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 62/126] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:39 2022] GET /identity/v3/role_assignments?user.id=3a97abd494c449669359c9f2360faab6&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=bee6c92a21d64b28b852f8719be02e65 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:39.266313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873c07e-bf90-4277-bcf9-9b52a23ab140 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:39.430977 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0fe88-5287-411d-bb25-87d5c3087e6b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:39.484184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee751d-7861-4cd4-96f8-bc9c974af106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:39.485053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee751d-7861-4cd4-96f8-bc9c974af106 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.485350 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee751d-7861-4cd4-96f8-bc9c974af106 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.485633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee751d-7861-4cd4-96f8-bc9c974af106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.490361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873c07e-bf90-4277-bcf9-9b52a23ab140 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:39.494090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:39.509300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee751d-7861-4cd4-96f8-bc9c974af106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-85ee751d-7861-4cd4-96f8-bc9c974af106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:39.517941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:39.518818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:39.519892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 65/127] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:39.520815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee751d-7861-4cd4-96f8-bc9c974af106 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:39.537194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29907f-5b32-460e-b893-540084310534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:39.538765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29907f-5b32-460e-b893-540084310534 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.539128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29907f-5b32-460e-b893-540084310534 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.539485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29907f-5b32-460e-b893-540084310534 None admin] PATH_INFO: `/v3/users/5b5a1eff07f9401787ed37895a56aafd` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.540875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29907f-5b32-460e-b893-540084310534 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5a1eff07f9401787ed37895a56aafd)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:39.542468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29907f-5b32-460e-b893-540084310534 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:39.544437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 63/128] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:39 2022] GET /identity/v3/users/5b5a1eff07f9401787ed37895a56aafd => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:39.545260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29907f-5b32-460e-b893-540084310534 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:39.607330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:39.678039 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee751d-7861-4cd4-96f8-bc9c974af106 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:39.723710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29907f-5b32-460e-b893-540084310534 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:39.749322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194a3d0-ab9c-454c-897d-e77cd91041f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:39.750222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a3d0-ab9c-454c-897d-e77cd91041f0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.750514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a3d0-ab9c-454c-897d-e77cd91041f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.750797 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a3d0-ab9c-454c-897d-e77cd91041f0 None admin] PATH_INFO: `/v3/users/5b5a1eff07f9401787ed37895a56aafd` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.752179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194a3d0-ab9c-454c-897d-e77cd91041f0 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5a1eff07f9401787ed37895a56aafd)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:39.753675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194a3d0-ab9c-454c-897d-e77cd91041f0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:39.755523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 66/129] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:39 2022] GET /identity/v3/users/5b5a1eff07f9401787ed37895a56aafd => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:39.756084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194a3d0-ab9c-454c-897d-e77cd91041f0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:39.802929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940c5b3-7d91-4562-b7b9-80e66825430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:39.803836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940c5b3-7d91-4562-b7b9-80e66825430a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.804130 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940c5b3-7d91-4562-b7b9-80e66825430a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.804416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940c5b3-7d91-4562-b7b9-80e66825430a None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.805221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940c5b3-7d91-4562-b7b9-80e66825430a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:39.805541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940c5b3-7d91-4562-b7b9-80e66825430a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:39.806964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940c5b3-7d91-4562-b7b9-80e66825430a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:39.823247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 64/130] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:39.823938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940c5b3-7d91-4562-b7b9-80e66825430a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:39.876512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:39.930134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194a3d0-ab9c-454c-897d-e77cd91041f0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:39.988533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9a32f-fab4-4fd9-923c-6444b025b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:39.989508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9a32f-fab4-4fd9-923c-6444b025b981 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:39.989796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9a32f-fab4-4fd9-923c-6444b025b981 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:39.990075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9a32f-fab4-4fd9-923c-6444b025b981 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:39.992460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9a32f-fab4-4fd9-923c-6444b025b981 None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:39.994150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9a32f-fab4-4fd9-923c-6444b025b981 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:39.996773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 67/131] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:39 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:39.997720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9a32f-fab4-4fd9-923c-6444b025b981 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:40.005615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:40.012029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940c5b3-7d91-4562-b7b9-80e66825430a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:40.070078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396d910-600d-49cd-9e20-f4a7271cdda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:40.070961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396d910-600d-49cd-9e20-f4a7271cdda2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.071250 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396d910-600d-49cd-9e20-f4a7271cdda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.071531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396d910-600d-49cd-9e20-f4a7271cdda2 None admin] PATH_INFO: `/v3/projects/8d083244ce3044329a5b69289fac999d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.073064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396d910-600d-49cd-9e20-f4a7271cdda2 None admin] RBAC: Authorizing `identity:get_project(project_id=8d083244ce3044329a5b69289fac999d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:40.075522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396d910-600d-49cd-9e20-f4a7271cdda2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:40.077330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 65/132] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:39 2022] GET /identity/v3/projects/8d083244ce3044329a5b69289fac999d => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:40.078091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396d910-600d-49cd-9e20-f4a7271cdda2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:40.180225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9a32f-fab4-4fd9-923c-6444b025b981 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:40.210811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:40.217659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29517661-8bc2-4108-8916-ac62d7a583c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:40.218553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29517661-8bc2-4108-8916-ac62d7a583c0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.218847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29517661-8bc2-4108-8916-ac62d7a583c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.219131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29517661-8bc2-4108-8916-ac62d7a583c0 None admin] PATH_INFO: `/v3/users/c3f241eb29634e3ba6cabbf8247be6c4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.220372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29517661-8bc2-4108-8916-ac62d7a583c0 None admin] RBAC: Authorizing `identity:get_user(user_id=c3f241eb29634e3ba6cabbf8247be6c4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:40.222290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29517661-8bc2-4108-8916-ac62d7a583c0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:40.224073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 68/133] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:39 2022] GET /identity/v3/users/c3f241eb29634e3ba6cabbf8247be6c4 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:40.224865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29517661-8bc2-4108-8916-ac62d7a583c0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:40.299554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396d910-600d-49cd-9e20-f4a7271cdda2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:40.335778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29517661-8bc2-4108-8916-ac62d7a583c0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:40.372597 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024ff47-5164-44da-88c2-f44e4205e3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:40.373802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024ff47-5164-44da-88c2-f44e4205e3da None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.374099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024ff47-5164-44da-88c2-f44e4205e3da None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.374383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024ff47-5164-44da-88c2-f44e4205e3da None admin] PATH_INFO: `/v3/projects/8d083244ce3044329a5b69289fac999d/users/5b5a1eff07f9401787ed37895a56aafd/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.376391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024ff47-5164-44da-88c2-f44e4205e3da None admin] RBAC: Authorizing `identity:create_grant(project_id=8d083244ce3044329a5b69289fac999d, user_id=5b5a1eff07f9401787ed37895a56aafd, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:40.378137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024ff47-5164-44da-88c2-f44e4205e3da None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:40.390314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8e841-f8a3-41b8-a629-67ca91492c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:40.391272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e841-f8a3-41b8-a629-67ca91492c6d None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.391568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e841-f8a3-41b8-a629-67ca91492c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.391899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e841-f8a3-41b8-a629-67ca91492c6d None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900/users/5b5a1eff07f9401787ed37895a56aafd/roles/0af0bb9954e74b6c9158c0ea76a2c7a5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.393555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 69/134] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:40 2022] PUT /identity/v3/projects/8d083244ce3044329a5b69289fac999d/users/5b5a1eff07f9401787ed37895a56aafd/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:40.394349 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8e841-f8a3-41b8-a629-67ca91492c6d None admin] RBAC: Authorizing `identity:create_grant(project_id=9f140c317e2e4605b3c3ef8420147900, user_id=5b5a1eff07f9401787ed37895a56aafd, role_id=0af0bb9954e74b6c9158c0ea76a2c7a5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:40.394456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024ff47-5164-44da-88c2-f44e4205e3da None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:40.395792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8e841-f8a3-41b8-a629-67ca91492c6d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:40.428930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 66/135] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:40 2022] PUT /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900/users/5b5a1eff07f9401787ed37895a56aafd/roles/0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:40.430385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dc65d-dfeb-4689-ae7f-b77e103c3a6c None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.430653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dc65d-dfeb-4689-ae7f-b77e103c3a6c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.430942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dc65d-dfeb-4689-ae7f-b77e103c3a6c None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.432244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 67/136] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:40.442286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0a99a-a5d0-4f44-a0b7-9935d792936e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.442598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0a99a-a5d0-4f44-a0b7-9935d792936e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.442863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0a99a-a5d0-4f44-a0b7-9935d792936e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.475810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:40.478724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1ee0a99a-a5d0-4f44-a0b7-9935d792936e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:40.480088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1ee0a99a-a5d0-4f44-a0b7-9935d792936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:40.524175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024ff47-5164-44da-88c2-f44e4205e3da None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:40.547610 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:40.571518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dff09-2f0f-4ded-adf3-94abba15990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:40.573740 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dff09-2f0f-4ded-adf3-94abba15990b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.574206 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dff09-2f0f-4ded-adf3-94abba15990b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.574632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dff09-2f0f-4ded-adf3-94abba15990b None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.576156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dff09-2f0f-4ded-adf3-94abba15990b None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:40.577837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dff09-2f0f-4ded-adf3-94abba15990b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:40.580650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 70/137] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:40 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:40.591258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dff09-2f0f-4ded-adf3-94abba15990b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:40.650426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 68/138] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:40.691244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0a99a-a5d0-4f44-a0b7-9935d792936e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:40.753112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dff09-2f0f-4ded-adf3-94abba15990b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:40.780926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:40.792755 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0388a-0c23-4225-b8b7-c8b73ea218d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:40.793986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0388a-0c23-4225-b8b7-c8b73ea218d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.794492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0388a-0c23-4225-b8b7-c8b73ea218d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.794972 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0388a-0c23-4225-b8b7-c8b73ea218d4 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900/users/c3f241eb29634e3ba6cabbf8247be6c4/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.797184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0388a-0c23-4225-b8b7-c8b73ea218d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f140c317e2e4605b3c3ef8420147900, user_id=c3f241eb29634e3ba6cabbf8247be6c4, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:40.798852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0388a-0c23-4225-b8b7-c8b73ea218d4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:40.820976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 71/139] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:40 2022] PUT /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900/users/c3f241eb29634e3ba6cabbf8247be6c4/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:59:40.822668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0a99a-a5d0-4f44-a0b7-9935d792936e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:40.868458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184f396-19c9-44ba-bdf9-04e93c28064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:40.869378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184f396-19c9-44ba-bdf9-04e93c28064b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:40.869673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184f396-19c9-44ba-bdf9-04e93c28064b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:40.869952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184f396-19c9-44ba-bdf9-04e93c28064b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:40.873687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184f396-19c9-44ba-bdf9-04e93c28064b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:40.875230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184f396-19c9-44ba-bdf9-04e93c28064b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:40.877107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 69/140] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:40.883679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0388a-0c23-4225-b8b7-c8b73ea218d4 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:41.010099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0388a-0c23-4225-b8b7-c8b73ea218d4 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:41.060698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d41987-e414-458f-a7dd-e45863cce287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:41.061760 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41987-e414-458f-a7dd-e45863cce287 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:41.062334 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41987-e414-458f-a7dd-e45863cce287 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:41.062809 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41987-e414-458f-a7dd-e45863cce287 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:41.063741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d41987-e414-458f-a7dd-e45863cce287 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:41.065433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d41987-e414-458f-a7dd-e45863cce287 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:41.089137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 72/141] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:40 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:42.079733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929b3d-5b25-495d-893e-4a93d7f6c366 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.080213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929b3d-5b25-495d-893e-4a93d7f6c366 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.080305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929b3d-5b25-495d-893e-4a93d7f6c366 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.081876 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 70/142] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:42.088085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d215-ca4f-41e4-88ae-fb075e81938b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.088525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d215-ca4f-41e4-88ae-fb075e81938b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.088726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d215-ca4f-41e4-88ae-fb075e81938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.111571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f6f5d215-ca4f-41e4-88ae-fb075e81938b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:42.112796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f6f5d215-ca4f-41e4-88ae-fb075e81938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:42.155361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:42.200668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 73/143] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:42.245324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33929b3d-5b25-495d-893e-4a93d7f6c366 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:42.283313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:42.398907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33929b3d-5b25-495d-893e-4a93d7f6c366 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:42.444441 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e5b9f-8f69-4a9a-833c-3bd46b95d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:42.445361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e5b9f-8f69-4a9a-833c-3bd46b95d709 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.445850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e5b9f-8f69-4a9a-833c-3bd46b95d709 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.446135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e5b9f-8f69-4a9a-833c-3bd46b95d709 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.462477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e5b9f-8f69-4a9a-833c-3bd46b95d709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-a60e5b9f-8f69-4a9a-833c-3bd46b95d709 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:42.470296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:42.471174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:42.471961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 71/144] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:42.477734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5d215-ca4f-41e4-88ae-fb075e81938b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:42.629520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5d215-ca4f-41e4-88ae-fb075e81938b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:42.634241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1aafe-8e24-4039-b674-8560522cfd84 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.634536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1aafe-8e24-4039-b674-8560522cfd84 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.634822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1aafe-8e24-4039-b674-8560522cfd84 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.636223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 72/145] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:42.645997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afcb86-5c00-4b41-adc3-fcf71ff8460c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.646290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afcb86-5c00-4b41-adc3-fcf71ff8460c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.646573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afcb86-5c00-4b41-adc3-fcf71ff8460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.668932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac7c8c-e55d-486a-8fc9-39a515722cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:42.669535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac7c8c-e55d-486a-8fc9-39a515722cdf None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.669818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac7c8c-e55d-486a-8fc9-39a515722cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.670098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac7c8c-e55d-486a-8fc9-39a515722cdf None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.670853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac7c8c-e55d-486a-8fc9-39a515722cdf None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:42.671428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac7c8c-e55d-486a-8fc9-39a515722cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:42.672862 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac7c8c-e55d-486a-8fc9-39a515722cdf None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:42.681662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-40afcb86-5c00-4b41-adc3-fcf71ff8460c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:42.682893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-40afcb86-5c00-4b41-adc3-fcf71ff8460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:42.683020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 74/146] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:42.688956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac7c8c-e55d-486a-8fc9-39a515722cdf None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:42.743185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:42.785937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 73/147] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:42.819015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac7c8c-e55d-486a-8fc9-39a515722cdf None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:42.824467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afcb86-5c00-4b41-adc3-fcf71ff8460c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:42.852052 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:42.857010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc99d5-0f83-43fa-aa4d-9527ca9f4456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:42.858467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc99d5-0f83-43fa-aa4d-9527ca9f4456 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:42.858759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc99d5-0f83-43fa-aa4d-9527ca9f4456 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:42.859032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc99d5-0f83-43fa-aa4d-9527ca9f4456 None admin] PATH_INFO: `/v3/users/5b5a1eff07f9401787ed37895a56aafd` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:42.860266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc99d5-0f83-43fa-aa4d-9527ca9f4456 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5a1eff07f9401787ed37895a56aafd)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:42.861768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc99d5-0f83-43fa-aa4d-9527ca9f4456 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:42.863532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 75/148] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:42 2022] GET /identity/v3/users/5b5a1eff07f9401787ed37895a56aafd => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:42.869375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc99d5-0f83-43fa-aa4d-9527ca9f4456 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:42.979347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc99d5-0f83-43fa-aa4d-9527ca9f4456 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:42.981782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:42.996987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afcb86-5c00-4b41-adc3-fcf71ff8460c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:43.021599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f8217-7abb-4db4-afa8-c7ad0a840422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:43.022493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f8217-7abb-4db4-afa8-c7ad0a840422 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.022493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f8217-7abb-4db4-afa8-c7ad0a840422 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.023147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f8217-7abb-4db4-afa8-c7ad0a840422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.071808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a1aa7-d858-465c-82af-daef8eb20e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:43.072644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a1aa7-d858-465c-82af-daef8eb20e31 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.072915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a1aa7-d858-465c-82af-daef8eb20e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.073188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a1aa7-d858-465c-82af-daef8eb20e31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.097969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a1aa7-d858-465c-82af-daef8eb20e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f76a1aa7-d858-465c-82af-daef8eb20e31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:43.119816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:43.121959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:43.123851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 74/149] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:43.129802 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a1aa7-d858-465c-82af-daef8eb20e31 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:43.167197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f8217-7abb-4db4-afa8-c7ad0a840422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:43.176732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f8217-7abb-4db4-afa8-c7ad0a840422 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:43.306381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:43.320128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 76/150] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:59:43.325152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f8217-7abb-4db4-afa8-c7ad0a840422 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:43.336509 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:43.364557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a1aa7-d858-465c-82af-daef8eb20e31 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:43.466159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f8217-7abb-4db4-afa8-c7ad0a840422 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:43.477979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a33e8f-68b8-4b56-8ab6-0ae8b3d04cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:43.478974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a33e8f-68b8-4b56-8ab6-0ae8b3d04cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.479449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a33e8f-68b8-4b56-8ab6-0ae8b3d04cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.479912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a33e8f-68b8-4b56-8ab6-0ae8b3d04cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.480898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a33e8f-68b8-4b56-8ab6-0ae8b3d04cb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:43.481400 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a33e8f-68b8-4b56-8ab6-0ae8b3d04cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:43.483050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a33e8f-68b8-4b56-8ab6-0ae8b3d04cb7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:43.508269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 75/151] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:43.513344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a33e8f-68b8-4b56-8ab6-0ae8b3d04cb7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:43.515113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61400ee0-bbd9-43b8-b82b-ae4f33f812ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:43.515998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400ee0-bbd9-43b8-b82b-ae4f33f812ac None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.516285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400ee0-bbd9-43b8-b82b-ae4f33f812ac None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.516565 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400ee0-bbd9-43b8-b82b-ae4f33f812ac None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.517808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61400ee0-bbd9-43b8-b82b-ae4f33f812ac None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:43.519287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61400ee0-bbd9-43b8-b82b-ae4f33f812ac None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:43.521049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 77/152] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:43 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:43.532633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61400ee0-bbd9-43b8-b82b-ae4f33f812ac None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:43.642402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:43.679209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61400ee0-bbd9-43b8-b82b-ae4f33f812ac None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:43.698671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a33e8f-68b8-4b56-8ab6-0ae8b3d04cb7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:43.769356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7eb49a-b6a2-4087-880f-016ca205f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:43.770047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eb49a-b6a2-4087-880f-016ca205f027 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.770341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eb49a-b6a2-4087-880f-016ca205f027 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.770630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eb49a-b6a2-4087-880f-016ca205f027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.770731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151b319-7931-4e47-9a31-3df8d984af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:43.771495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7eb49a-b6a2-4087-880f-016ca205f027 None admin] RBAC: Adding query filter params (role.id=f5a5bdf6fee0438391dd54c5b545305e, scope.project.id=9f140c317e2e4605b3c3ef8420147900, user.id=5b5a1eff07f9401787ed37895a56aafd) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:43.771600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151b319-7931-4e47-9a31-3df8d984af89 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.771789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151b319-7931-4e47-9a31-3df8d984af89 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.771928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7eb49a-b6a2-4087-880f-016ca205f027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:43.772101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151b319-7931-4e47-9a31-3df8d984af89 None admin] PATH_INFO: `/v3/users/3a97abd494c449669359c9f2360faab6` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.773666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7eb49a-b6a2-4087-880f-016ca205f027 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:43.776765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151b319-7931-4e47-9a31-3df8d984af89 None admin] RBAC: Authorizing `identity:get_user(user_id=3a97abd494c449669359c9f2360faab6)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:43.778251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151b319-7931-4e47-9a31-3df8d984af89 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:43.780326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 76/153] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:43 2022] GET /identity/v3/users/3a97abd494c449669359c9f2360faab6 => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:43.781742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf2c5b-4613-4e86-b0e6-956a32eda521 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.782023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf2c5b-4613-4e86-b0e6-956a32eda521 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.782595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf2c5b-4613-4e86-b0e6-956a32eda521 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.784446 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 77/154] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:43.787459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf2c5b-4613-4e86-b0e6-956a32eda521 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:43.789081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 78/155] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:43 2022] GET /identity/v3/role_assignments?user.id=5b5a1eff07f9401787ed37895a56aafd&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:43.794378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0db28b-a767-4bcc-bd93-bf1e06899bf8 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.794674 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0db28b-a767-4bcc-bd93-bf1e06899bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.794960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0db28b-a767-4bcc-bd93-bf1e06899bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.799070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:43.829658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9a0db28b-a767-4bcc-bd93-bf1e06899bf8 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:43.830880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9a0db28b-a767-4bcc-bd93-bf1e06899bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:43.968140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 79/156] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:43.969450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fecbc-5dec-46ab-89ad-bcd9dee2ab7a None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.969741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fecbc-5dec-46ab-89ad-bcd9dee2ab7a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.970019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fecbc-5dec-46ab-89ad-bcd9dee2ab7a None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:43.971324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 80/157] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:43.986205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504adda-2634-43cf-98e2-8fb4f5877fd6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:43.986567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504adda-2634-43cf-98e2-8fb4f5877fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:43.986783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504adda-2634-43cf-98e2-8fb4f5877fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:44.014844 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6504adda-2634-43cf-98e2-8fb4f5877fd6 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:44.016079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6504adda-2634-43cf-98e2-8fb4f5877fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:44.019553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf2c5b-4613-4e86-b0e6-956a32eda521 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:44.104507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db690-9722-4fff-90e6-98d912099a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:44.105412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db690-9722-4fff-90e6-98d912099a5f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:44.105762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db690-9722-4fff-90e6-98d912099a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:44.105980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db690-9722-4fff-90e6-98d912099a5f None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:44.111986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62db690-9722-4fff-90e6-98d912099a5f None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:44.111986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62db690-9722-4fff-90e6-98d912099a5f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:44.112237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 78/158] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:43 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:44.113672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db690-9722-4fff-90e6-98d912099a5f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:44.120374 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:44.134258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 81/159] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 20 05:59:44.135873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504adda-2634-43cf-98e2-8fb4f5877fd6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:44.257238 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:44.281693 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db690-9722-4fff-90e6-98d912099a5f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:44.296709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504adda-2634-43cf-98e2-8fb4f5877fd6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:44.345343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12391668-4f74-4ee4-8182-cbd931123f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:44.346262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12391668-4f74-4ee4-8182-cbd931123f74 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:44.346553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12391668-4f74-4ee4-8182-cbd931123f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:44.346835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12391668-4f74-4ee4-8182-cbd931123f74 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900/users/3a97abd494c449669359c9f2360faab6/roles/bee6c92a21d64b28b852f8719be02e65` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:44.348933 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12391668-4f74-4ee4-8182-cbd931123f74 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f140c317e2e4605b3c3ef8420147900, user_id=3a97abd494c449669359c9f2360faab6, role_id=bee6c92a21d64b28b852f8719be02e65)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:44.350727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12391668-4f74-4ee4-8182-cbd931123f74 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:44.358450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39208b6-1eef-4775-84cb-a49bd011ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:44.359286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39208b6-1eef-4775-84cb-a49bd011ef62 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:44.359669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39208b6-1eef-4775-84cb-a49bd011ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:44.359964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39208b6-1eef-4775-84cb-a49bd011ef62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:44.379194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 82/160] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:44 2022] PUT /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900/users/3a97abd494c449669359c9f2360faab6/roles/bee6c92a21d64b28b852f8719be02e65 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:44.379815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12391668-4f74-4ee4-8182-cbd931123f74 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:44.380118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39208b6-1eef-4775-84cb-a49bd011ef62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-d39208b6-1eef-4775-84cb-a49bd011ef62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:44.396701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:44.398236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:44.399034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 79/161] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 05:59:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:44.415149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39208b6-1eef-4775-84cb-a49bd011ef62 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:44.472248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:44.555155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12391668-4f74-4ee4-8182-cbd931123f74 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:44.615161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151ae0c-a366-4dc5-85ce-587af1fbdff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:44.616590 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ae0c-a366-4dc5-85ce-587af1fbdff9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:44.616953 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ae0c-a366-4dc5-85ce-587af1fbdff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:44.617186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ae0c-a366-4dc5-85ce-587af1fbdff9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:44.629088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151ae0c-a366-4dc5-85ce-587af1fbdff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-2151ae0c-a366-4dc5-85ce-587af1fbdff9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:44.639728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:44.640840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:44.641659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:44.645282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 83/162] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:44.649517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151ae0c-a366-4dc5-85ce-587af1fbdff9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:44.656946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39208b6-1eef-4775-84cb-a49bd011ef62 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:44.722824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dfb52-82a5-4d1b-8030-149e3ef85c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:44.723619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dfb52-82a5-4d1b-8030-149e3ef85c63 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:44.723906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dfb52-82a5-4d1b-8030-149e3ef85c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:44.724185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dfb52-82a5-4d1b-8030-149e3ef85c63 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:44.725510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dfb52-82a5-4d1b-8030-149e3ef85c63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:44.725821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dfb52-82a5-4d1b-8030-149e3ef85c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:44.727348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dfb52-82a5-4d1b-8030-149e3ef85c63 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:44.728913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:44.740101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 80/163] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:44.766315 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dfb52-82a5-4d1b-8030-149e3ef85c63 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:44.782315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151ae0c-a366-4dc5-85ce-587af1fbdff9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:44.797574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:44.821497 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab51b49-bdfb-4b77-bacd-a465b9ab3135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:44.822259 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab51b49-bdfb-4b77-bacd-a465b9ab3135 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:44.822555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab51b49-bdfb-4b77-bacd-a465b9ab3135 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:44.822839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab51b49-bdfb-4b77-bacd-a465b9ab3135 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:44.823611 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab51b49-bdfb-4b77-bacd-a465b9ab3135 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:44.823928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab51b49-bdfb-4b77-bacd-a465b9ab3135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:44.825498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab51b49-bdfb-4b77-bacd-a465b9ab3135 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:44.835118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 84/164] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:44.841266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab51b49-bdfb-4b77-bacd-a465b9ab3135 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:44.954254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab51b49-bdfb-4b77-bacd-a465b9ab3135 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:44.992343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6344756-03e2-459f-8738-aed38cad11c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:44.993377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344756-03e2-459f-8738-aed38cad11c5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:44.993768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344756-03e2-459f-8738-aed38cad11c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:44.994060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344756-03e2-459f-8738-aed38cad11c5 None admin] PATH_INFO: `/v3/users/5b5a1eff07f9401787ed37895a56aafd` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:44.995318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6344756-03e2-459f-8738-aed38cad11c5 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5a1eff07f9401787ed37895a56aafd)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:44.996827 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6344756-03e2-459f-8738-aed38cad11c5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:44.998493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 85/165] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:44 2022] GET /identity/v3/users/5b5a1eff07f9401787ed37895a56aafd => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:45.003867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6344756-03e2-459f-8738-aed38cad11c5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:45.027660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dfb52-82a5-4d1b-8030-149e3ef85c63 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:45.057000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:45.090286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d109c-7b9e-493d-8042-d8fb74b9e3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:45.091188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d109c-7b9e-493d-8042-d8fb74b9e3db None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.091471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d109c-7b9e-493d-8042-d8fb74b9e3db None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.091750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d109c-7b9e-493d-8042-d8fb74b9e3db None admin] PATH_INFO: `/v3/users/5b5a1eff07f9401787ed37895a56aafd` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.097168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d109c-7b9e-493d-8042-d8fb74b9e3db None admin] RBAC: Authorizing `identity:get_user(user_id=5b5a1eff07f9401787ed37895a56aafd)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:45.098665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d109c-7b9e-493d-8042-d8fb74b9e3db None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:45.100365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 81/166] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:44 2022] GET /identity/v3/users/5b5a1eff07f9401787ed37895a56aafd => generated 275 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:45.101845 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396592-7c52-4c5f-86a1-2cf4d3a7c1d8 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.102135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396592-7c52-4c5f-86a1-2cf4d3a7c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.102415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396592-7c52-4c5f-86a1-2cf4d3a7c1d8 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.103933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 82/167] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:45.108093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06396592-7c52-4c5f-86a1-2cf4d3a7c1d8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:45.123360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6344756-03e2-459f-8738-aed38cad11c5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:45.160650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edbdd5-94a8-41c8-8289-12665bed3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:45.161648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edbdd5-94a8-41c8-8289-12665bed3841 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.162135 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edbdd5-94a8-41c8-8289-12665bed3841 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.163384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edbdd5-94a8-41c8-8289-12665bed3841 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.213290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:45.240186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edbdd5-94a8-41c8-8289-12665bed3841 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:45.242597 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edbdd5-94a8-41c8-8289-12665bed3841 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:45.282252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06396592-7c52-4c5f-86a1-2cf4d3a7c1d8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:45.293108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:45.319146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51d77-5089-43cb-922a-77bdeb09081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:45.319623 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51d77-5089-43cb-922a-77bdeb09081c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.319903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51d77-5089-43cb-922a-77bdeb09081c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.320182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51d77-5089-43cb-922a-77bdeb09081c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.355256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 86/168] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:59:45.357274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1136f89-10ce-4a60-b00e-d7adeb0cd24e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.357964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1136f89-10ce-4a60-b00e-d7adeb0cd24e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.361035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1136f89-10ce-4a60-b00e-d7adeb0cd24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.382300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f1136f89-10ce-4a60-b00e-d7adeb0cd24e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:45.384285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f1136f89-10ce-4a60-b00e-d7adeb0cd24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:45.393340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec51d77-5089-43cb-922a-77bdeb09081c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:45.395083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec51d77-5089-43cb-922a-77bdeb09081c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:45.458459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:45.459801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 87/169] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:45.461304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1136f89-10ce-4a60-b00e-d7adeb0cd24e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:45.510733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 83/170] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:59:45.514155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51d77-5089-43cb-922a-77bdeb09081c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:45.560992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:45.577952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1136f89-10ce-4a60-b00e-d7adeb0cd24e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:45.616734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51d77-5089-43cb-922a-77bdeb09081c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:45.637753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a67d0e-6eaa-4e20-a2f2-c98759632600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:45.638635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a67d0e-6eaa-4e20-a2f2-c98759632600 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.638917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a67d0e-6eaa-4e20-a2f2-c98759632600 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.639189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a67d0e-6eaa-4e20-a2f2-c98759632600 None admin] PATH_INFO: `/v3/projects/8d083244ce3044329a5b69289fac999d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.642399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a67d0e-6eaa-4e20-a2f2-c98759632600 None admin] RBAC: Authorizing `identity:get_project(project_id=8d083244ce3044329a5b69289fac999d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:45.643865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a67d0e-6eaa-4e20-a2f2-c98759632600 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:45.646887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 88/171] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/projects/8d083244ce3044329a5b69289fac999d => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:45.648268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a67d0e-6eaa-4e20-a2f2-c98759632600 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:45.697372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790ac62-75d1-4529-b1a2-e8e5e094033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:45.698176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ac62-75d1-4529-b1a2-e8e5e094033e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.698463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ac62-75d1-4529-b1a2-e8e5e094033e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.698743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ac62-75d1-4529-b1a2-e8e5e094033e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.719066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790ac62-75d1-4529-b1a2-e8e5e094033e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1790ac62-75d1-4529-b1a2-e8e5e094033e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:45.726914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:45.727824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:45.728733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 84/172] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:45.729432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790ac62-75d1-4529-b1a2-e8e5e094033e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:45.783597 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:45.829671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a67d0e-6eaa-4e20-a2f2-c98759632600 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:45.904528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c0b5d-8dbf-46bc-86b7-0f4b77781cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:45.905345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c0b5d-8dbf-46bc-86b7-0f4b77781cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.905673 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c0b5d-8dbf-46bc-86b7-0f4b77781cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.905955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c0b5d-8dbf-46bc-86b7-0f4b77781cd8 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.907363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c0b5d-8dbf-46bc-86b7-0f4b77781cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:45.910136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c0b5d-8dbf-46bc-86b7-0f4b77781cd8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:45.911848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 89/173] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:45.913164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae411-acd1-4a09-a8e4-7fc82cef756f None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.913373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae411-acd1-4a09-a8e4-7fc82cef756f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.913653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae411-acd1-4a09-a8e4-7fc82cef756f None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.916357 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 90/174] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:45.920560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae411-acd1-4a09-a8e4-7fc82cef756f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:45.929675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790ac62-75d1-4529-b1a2-e8e5e094033e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:45.948207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:45.999667 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b13a9b-459c-404c-9255-5e9e5cb54797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.000339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b13a9b-459c-404c-9255-5e9e5cb54797 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.000636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b13a9b-459c-404c-9255-5e9e5cb54797 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.000958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b13a9b-459c-404c-9255-5e9e5cb54797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.001802 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b13a9b-459c-404c-9255-5e9e5cb54797 None admin] RBAC: Adding query filter params (role.id=f5a5bdf6fee0438391dd54c5b545305e, scope.project.id=8d083244ce3044329a5b69289fac999d, user.id=5b5a1eff07f9401787ed37895a56aafd) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:46.002117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b13a9b-459c-404c-9255-5e9e5cb54797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:46.003592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b13a9b-459c-404c-9255-5e9e5cb54797 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:46.014256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 85/175] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/role_assignments?user.id=5b5a1eff07f9401787ed37895a56aafd&scope.project.id=8d083244ce3044329a5b69289fac999d&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:46.015380 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42fd85-a246-4465-9b36-8917248e59b0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.015607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42fd85-a246-4465-9b36-8917248e59b0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.015888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42fd85-a246-4465-9b36-8917248e59b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.056356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7e42fd85-a246-4465-9b36-8917248e59b0 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:46.057613 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7e42fd85-a246-4465-9b36-8917248e59b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:46.118674 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae411-acd1-4a09-a8e4-7fc82cef756f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:46.155759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 86/176] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:46.156550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42fd85-a246-4465-9b36-8917248e59b0 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:46.187248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:46.199012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d59cc-b4b9-4e4b-b1b3-a48b821b7850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.199835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d59cc-b4b9-4e4b-b1b3-a48b821b7850 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.200120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d59cc-b4b9-4e4b-b1b3-a48b821b7850 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.200395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d59cc-b4b9-4e4b-b1b3-a48b821b7850 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.201184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d59cc-b4b9-4e4b-b1b3-a48b821b7850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:46.201491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d59cc-b4b9-4e4b-b1b3-a48b821b7850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:46.202898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d59cc-b4b9-4e4b-b1b3-a48b821b7850 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:46.231570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 91/177] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:46.236748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d59cc-b4b9-4e4b-b1b3-a48b821b7850 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:46.312418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42fd85-a246-4465-9b36-8917248e59b0 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:46.348586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:46.361783 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da0e15-cbb2-476d-83f6-5fbc5bc39bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.362910 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da0e15-cbb2-476d-83f6-5fbc5bc39bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.363193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da0e15-cbb2-476d-83f6-5fbc5bc39bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.363731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da0e15-cbb2-476d-83f6-5fbc5bc39bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.364585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da0e15-cbb2-476d-83f6-5fbc5bc39bc4 None admin] RBAC: Adding query filter params (role.id=0af0bb9954e74b6c9158c0ea76a2c7a5, scope.project.id=9f140c317e2e4605b3c3ef8420147900, user.id=5b5a1eff07f9401787ed37895a56aafd) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:46.365170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da0e15-cbb2-476d-83f6-5fbc5bc39bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:46.367188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da0e15-cbb2-476d-83f6-5fbc5bc39bc4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:46.375724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 87/178] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:46 2022] GET /identity/v3/role_assignments?user.id=5b5a1eff07f9401787ed37895a56aafd&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:46.376771 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da0e15-cbb2-476d-83f6-5fbc5bc39bc4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:46.386932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d59cc-b4b9-4e4b-b1b3-a48b821b7850 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:46.442927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efc84c-78ea-4d98-b4ab-2c5b9a0f9f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.444264 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efc84c-78ea-4d98-b4ab-2c5b9a0f9f8d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.444985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efc84c-78ea-4d98-b4ab-2c5b9a0f9f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.445271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efc84c-78ea-4d98-b4ab-2c5b9a0f9f8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.461874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efc84c-78ea-4d98-b4ab-2c5b9a0f9f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-56efc84c-78ea-4d98-b4ab-2c5b9a0f9f8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:46.469858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:46.470843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:46.472081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 92/179] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:46.472992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3235d2-7086-46cc-9b7a-2f2df137ec89 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.472992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3235d2-7086-46cc-9b7a-2f2df137ec89 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.473111 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3235d2-7086-46cc-9b7a-2f2df137ec89 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.474621 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 93/180] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:46.476881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3235d2-7086-46cc-9b7a-2f2df137ec89 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:46.499968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:46.538138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da0e15-cbb2-476d-83f6-5fbc5bc39bc4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:46.614095 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896be39-f498-45bc-86cb-129188ade4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.621132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896be39-f498-45bc-86cb-129188ade4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.621822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896be39-f498-45bc-86cb-129188ade4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.622803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896be39-f498-45bc-86cb-129188ade4e5 None admin] PATH_INFO: `/v3/users/c3f241eb29634e3ba6cabbf8247be6c4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.627529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896be39-f498-45bc-86cb-129188ade4e5 None admin] RBAC: Authorizing `identity:get_user(user_id=c3f241eb29634e3ba6cabbf8247be6c4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:46.629047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896be39-f498-45bc-86cb-129188ade4e5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:46.630718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 88/181] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:46 2022] GET /identity/v3/users/c3f241eb29634e3ba6cabbf8247be6c4 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:46.635646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e766f-286b-4a06-ae19-eda5b44f017d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.635931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e766f-286b-4a06-ae19-eda5b44f017d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.636210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e766f-286b-4a06-ae19-eda5b44f017d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.660773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5b1e766f-286b-4a06-ae19-eda5b44f017d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:46.662036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5b1e766f-286b-4a06-ae19-eda5b44f017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:46.675852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3235d2-7086-46cc-9b7a-2f2df137ec89 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:46.715170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:46.724644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec49eb8-0b30-433b-990b-5aa088ab1dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.725684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49eb8-0b30-433b-990b-5aa088ab1dfb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.726042 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49eb8-0b30-433b-990b-5aa088ab1dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.726332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49eb8-0b30-433b-990b-5aa088ab1dfb None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.727093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec49eb8-0b30-433b-990b-5aa088ab1dfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:46.727404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec49eb8-0b30-433b-990b-5aa088ab1dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:46.728824 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec49eb8-0b30-433b-990b-5aa088ab1dfb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:46.738428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 94/182] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:46.739064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec49eb8-0b30-433b-990b-5aa088ab1dfb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:46.757304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 89/183] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:46.758711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d4026-9cc4-4dc2-a28f-29d09918712e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.759011 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d4026-9cc4-4dc2-a28f-29d09918712e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.759288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d4026-9cc4-4dc2-a28f-29d09918712e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.762627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 90/184] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:46.762627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d4026-9cc4-4dc2-a28f-29d09918712e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:46.851527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:46.852807 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec49eb8-0b30-433b-990b-5aa088ab1dfb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:46.873242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d4026-9cc4-4dc2-a28f-29d09918712e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:46.888297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f29b85-50e7-47c6-bc4b-6621ab35fa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.888983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f29b85-50e7-47c6-bc4b-6621ab35fa6c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.889269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f29b85-50e7-47c6-bc4b-6621ab35fa6c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.889547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f29b85-50e7-47c6-bc4b-6621ab35fa6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.907918 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4ae24-76a5-472c-8780-0fbfc119e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.908825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4ae24-76a5-472c-8780-0fbfc119e856 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.909367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4ae24-76a5-472c-8780-0fbfc119e856 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.909642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4ae24-76a5-472c-8780-0fbfc119e856 None admin] PATH_INFO: `/v3/users/d743bc996f2f489d8341e3ce991cfa69` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.923449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4ae24-76a5-472c-8780-0fbfc119e856 None admin] RBAC: Authorizing `identity:get_user(user_id=d743bc996f2f489d8341e3ce991cfa69)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:46.924968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4ae24-76a5-472c-8780-0fbfc119e856 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:46.926663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 91/185] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:46 2022] GET /identity/v3/users/d743bc996f2f489d8341e3ce991cfa69 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:46.930052 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49819e1f-2bf9-4cc6-92f2-346c0a414fb6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.930696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49819e1f-2bf9-4cc6-92f2-346c0a414fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.931068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49819e1f-2bf9-4cc6-92f2-346c0a414fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.947962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-49819e1f-2bf9-4cc6-92f2-346c0a414fb6 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:46.949323 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-49819e1f-2bf9-4cc6-92f2-346c0a414fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:46.955259 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:46.964213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f29b85-50e7-47c6-bc4b-6621ab35fa6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:46.965910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f29b85-50e7-47c6-bc4b-6621ab35fa6c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:47.029523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 92/186] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:47.030586 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49819e1f-2bf9-4cc6-92f2-346c0a414fb6 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:47.084652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 95/187] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:59:47.085596 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f29b85-50e7-47c6-bc4b-6621ab35fa6c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:47.114893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:47.151306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49819e1f-2bf9-4cc6-92f2-346c0a414fb6 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:47.186841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1e72a-d3f5-4165-baef-1284a5b87069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:47.187659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1e72a-d3f5-4165-baef-1284a5b87069 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:47.187955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1e72a-d3f5-4165-baef-1284a5b87069 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:47.188237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1e72a-d3f5-4165-baef-1284a5b87069 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:47.193982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:47.199226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1e72a-d3f5-4165-baef-1284a5b87069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:47.202034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f29b85-50e7-47c6-bc4b-6621ab35fa6c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-9ec1e72a-d3f5-4165-baef-1284a5b87069 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:47.207495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:47.208392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 93/188] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 05:59:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:47.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1e72a-d3f5-4165-baef-1284a5b87069 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:47.239503 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6fbed-db41-40b2-98cb-f3c35711c941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:47.240084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6fbed-db41-40b2-98cb-f3c35711c941 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:47.240372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6fbed-db41-40b2-98cb-f3c35711c941 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:47.241327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6fbed-db41-40b2-98cb-f3c35711c941 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:47.316992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1e72a-d3f5-4165-baef-1284a5b87069 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:47.317593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6fbed-db41-40b2-98cb-f3c35711c941 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:47.319513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6fbed-db41-40b2-98cb-f3c35711c941 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:47.345540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:47.354054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a60cc1-c614-4a51-b2f6-4dc41c66fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:47.354859 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a60cc1-c614-4a51-b2f6-4dc41c66fb54 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:47.355139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a60cc1-c614-4a51-b2f6-4dc41c66fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:47.355413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a60cc1-c614-4a51-b2f6-4dc41c66fb54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:47.356580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a60cc1-c614-4a51-b2f6-4dc41c66fb54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:47.358094 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a60cc1-c614-4a51-b2f6-4dc41c66fb54 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:47.359709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 94/189] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:47.361495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a60cc1-c614-4a51-b2f6-4dc41c66fb54 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:47.422936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:47.431213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 96/190] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:59:47.432013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6fbed-db41-40b2-98cb-f3c35711c941 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:47.464242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a60cc1-c614-4a51-b2f6-4dc41c66fb54 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:47.497242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e85935-3be0-4159-93a6-bed4723d67cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:47.498036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85935-3be0-4159-93a6-bed4723d67cc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:47.498322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85935-3be0-4159-93a6-bed4723d67cc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:47.498600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85935-3be0-4159-93a6-bed4723d67cc None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:47.499812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e85935-3be0-4159-93a6-bed4723d67cc None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:47.501301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e85935-3be0-4159-93a6-bed4723d67cc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:47.502998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 95/191] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:47 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:47.502998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e85935-3be0-4159-93a6-bed4723d67cc None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:47.529068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6fbed-db41-40b2-98cb-f3c35711c941 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:47.562176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861e00e-f88c-4586-b08d-b5394c05ac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:47.562881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861e00e-f88c-4586-b08d-b5394c05ac3f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:47.563116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861e00e-f88c-4586-b08d-b5394c05ac3f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:47.563396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861e00e-f88c-4586-b08d-b5394c05ac3f None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:47.564137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861e00e-f88c-4586-b08d-b5394c05ac3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:47.564470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861e00e-f88c-4586-b08d-b5394c05ac3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:47.565925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861e00e-f88c-4586-b08d-b5394c05ac3f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:47.566421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:47.574763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 97/192] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:47.577168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a36068-b9f4-41c0-8529-a8af99b1083b None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:47.577460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a36068-b9f4-41c0-8529-a8af99b1083b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:47.577739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a36068-b9f4-41c0-8529-a8af99b1083b None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:47.579147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 98/193] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:47.579717 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a36068-b9f4-41c0-8529-a8af99b1083b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:47.610590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e85935-3be0-4159-93a6-bed4723d67cc None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:47.641165 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:47.648460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1ae59-7e3e-49da-b093-54564fff45ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:47.649160 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1ae59-7e3e-49da-b093-54564fff45ce None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:47.649449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1ae59-7e3e-49da-b093-54564fff45ce None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:47.649729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1ae59-7e3e-49da-b093-54564fff45ce None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:47.650439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1ae59-7e3e-49da-b093-54564fff45ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:47.651897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1ae59-7e3e-49da-b093-54564fff45ce None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:47.678112 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 96/194] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:47 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:47.678950 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1ae59-7e3e-49da-b093-54564fff45ce None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:47.695573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a36068-b9f4-41c0-8529-a8af99b1083b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:47.732988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78c438-238e-4840-9763-930d9c13195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:47.733886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78c438-238e-4840-9763-930d9c13195c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:47.734164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78c438-238e-4840-9763-930d9c13195c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:47.734438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78c438-238e-4840-9763-930d9c13195c None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:47.735738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78c438-238e-4840-9763-930d9c13195c None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:47.737272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78c438-238e-4840-9763-930d9c13195c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:47.744052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 99/195] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:47 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:47.744052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78c438-238e-4840-9763-930d9c13195c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:47.817114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1ae59-7e3e-49da-b093-54564fff45ce None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:47.842833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:47.859454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78c438-238e-4840-9763-930d9c13195c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:47.863678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799914e-48b1-4180-b851-98b544373dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:47.864359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799914e-48b1-4180-b851-98b544373dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:47.864670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799914e-48b1-4180-b851-98b544373dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:47.864954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799914e-48b1-4180-b851-98b544373dc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:47.865896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799914e-48b1-4180-b851-98b544373dc4 None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=9f140c317e2e4605b3c3ef8420147900, user.id=c3f241eb29634e3ba6cabbf8247be6c4) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:47.866222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799914e-48b1-4180-b851-98b544373dc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:47.867776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799914e-48b1-4180-b851-98b544373dc4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:47.874936 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 97/196] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:47 2022] GET /identity/v3/role_assignments?user.id=c3f241eb29634e3ba6cabbf8247be6c4&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=efc16976111d431c9173186cbd0e6c24 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:47.875981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464e0f2-0825-4c2a-9fc7-6f28b8820109 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:47.876267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464e0f2-0825-4c2a-9fc7-6f28b8820109 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:47.876539 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464e0f2-0825-4c2a-9fc7-6f28b8820109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:47.888295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:47.896668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1464e0f2-0825-4c2a-9fc7-6f28b8820109 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:47.898553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1464e0f2-0825-4c2a-9fc7-6f28b8820109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:47.904242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a84fe5-fa15-4504-8442-67c7baf924f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:47.905183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84fe5-fa15-4504-8442-67c7baf924f1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:47.905468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84fe5-fa15-4504-8442-67c7baf924f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:47.905742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84fe5-fa15-4504-8442-67c7baf924f1 None admin] PATH_INFO: `/v3/users/d743bc996f2f489d8341e3ce991cfa69` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:47.910508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a84fe5-fa15-4504-8442-67c7baf924f1 None admin] RBAC: Authorizing `identity:get_user(user_id=d743bc996f2f489d8341e3ce991cfa69)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:47.913589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a84fe5-fa15-4504-8442-67c7baf924f1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:47.916747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 100/197] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:47 2022] GET /identity/v3/users/d743bc996f2f489d8341e3ce991cfa69 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:47.918720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a84fe5-fa15-4504-8442-67c7baf924f1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:47.984674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 98/198] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:47.986094 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464e0f2-0825-4c2a-9fc7-6f28b8820109 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.056054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a84fe5-fa15-4504-8442-67c7baf924f1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.101482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7c71f-e9dd-4e66-8238-edb461294e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.102427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7c71f-e9dd-4e66-8238-edb461294e29 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.102864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7c71f-e9dd-4e66-8238-edb461294e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.103142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7c71f-e9dd-4e66-8238-edb461294e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.103987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7c71f-e9dd-4e66-8238-edb461294e29 None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a, user.id=d743bc996f2f489d8341e3ce991cfa69) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:48.104303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7c71f-e9dd-4e66-8238-edb461294e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:48.105917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7c71f-e9dd-4e66-8238-edb461294e29 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:48.112153 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 101/199] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:47 2022] GET /identity/v3/role_assignments?user.id=d743bc996f2f489d8341e3ce991cfa69&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=efc16976111d431c9173186cbd0e6c24 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:48.112819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7c71f-e9dd-4e66-8238-edb461294e29 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.128504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464e0f2-0825-4c2a-9fc7-6f28b8820109 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.146070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.167980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20898872-8315-476b-87f8-2117e52cfecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.169054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20898872-8315-476b-87f8-2117e52cfecd None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.169550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20898872-8315-476b-87f8-2117e52cfecd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.170037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20898872-8315-476b-87f8-2117e52cfecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.176116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.231242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7c71f-e9dd-4e66-8238-edb461294e29 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.260382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20898872-8315-476b-87f8-2117e52cfecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:48.266836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20898872-8315-476b-87f8-2117e52cfecd None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:48.270515 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0c018-6a84-47ab-96a6-149ab548da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.272309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0c018-6a84-47ab-96a6-149ab548da6b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.272309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0c018-6a84-47ab-96a6-149ab548da6b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.272511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0c018-6a84-47ab-96a6-149ab548da6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.285157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0c018-6a84-47ab-96a6-149ab548da6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-3ed0c018-6a84-47ab-96a6-149ab548da6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:48.296637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:48.297614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:48.298422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 102/200] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:48.301263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0c018-6a84-47ab-96a6-149ab548da6b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.415791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0c018-6a84-47ab-96a6-149ab548da6b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.433628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.438825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 99/201] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:59:48.446569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20898872-8315-476b-87f8-2117e52cfecd None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.459788 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ef5e9-53ec-4180-ab18-b26a65bb1fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.460486 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ef5e9-53ec-4180-ab18-b26a65bb1fda None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.460798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ef5e9-53ec-4180-ab18-b26a65bb1fda None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.461077 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ef5e9-53ec-4180-ab18-b26a65bb1fda None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.461842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ef5e9-53ec-4180-ab18-b26a65bb1fda None admin] RBAC: Adding query filter params (name=reader) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:48.462149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ef5e9-53ec-4180-ab18-b26a65bb1fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:48.463585 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ef5e9-53ec-4180-ab18-b26a65bb1fda None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:48.478578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 103/202] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:48.485375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ef5e9-53ec-4180-ab18-b26a65bb1fda None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.488645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.592304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ef5e9-53ec-4180-ab18-b26a65bb1fda None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.618255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20898872-8315-476b-87f8-2117e52cfecd None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.649365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acd09f-f9af-4421-bcfb-7f09d706cc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.650261 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd09f-f9af-4421-bcfb-7f09d706cc54 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.650549 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd09f-f9af-4421-bcfb-7f09d706cc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.650825 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acd09f-f9af-4421-bcfb-7f09d706cc54 None admin] PATH_INFO: `/v3/users/3a97abd494c449669359c9f2360faab6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.652099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acd09f-f9af-4421-bcfb-7f09d706cc54 None admin] RBAC: Authorizing `identity:get_user(user_id=3a97abd494c449669359c9f2360faab6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:48.653606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acd09f-f9af-4421-bcfb-7f09d706cc54 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:48.655605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 104/203] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/users/3a97abd494c449669359c9f2360faab6 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:48.661079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acd09f-f9af-4421-bcfb-7f09d706cc54 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.667690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e710f-1ae8-42e9-961a-7e2aa76499c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.668508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e710f-1ae8-42e9-961a-7e2aa76499c1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.668833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e710f-1ae8-42e9-961a-7e2aa76499c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.669114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e710f-1ae8-42e9-961a-7e2aa76499c1 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.670351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e710f-1ae8-42e9-961a-7e2aa76499c1 None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:48.671840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e710f-1ae8-42e9-961a-7e2aa76499c1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:48.673902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 100/204] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:48.680254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e710f-1ae8-42e9-961a-7e2aa76499c1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:48.745819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.829608 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.861621 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acd09f-f9af-4421-bcfb-7f09d706cc54 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.865022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e710f-1ae8-42e9-961a-7e2aa76499c1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:48.909558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9f79b-6131-46ab-84a3-c5c458f1b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.910218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9f79b-6131-46ab-84a3-c5c458f1b170 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.910506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9f79b-6131-46ab-84a3-c5c458f1b170 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.910786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9f79b-6131-46ab-84a3-c5c458f1b170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.941565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e6487-bc6b-4794-bd36-7a7167c3d48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:48.942143 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e6487-bc6b-4794-bd36-7a7167c3d48e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.942429 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e6487-bc6b-4794-bd36-7a7167c3d48e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.942708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e6487-bc6b-4794-bd36-7a7167c3d48e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.943595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e6487-bc6b-4794-bd36-7a7167c3d48e None admin] RBAC: Adding query filter params (role.id=0af0bb9954e74b6c9158c0ea76a2c7a5, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a, user.id=d743bc996f2f489d8341e3ce991cfa69) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:48.944021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e6487-bc6b-4794-bd36-7a7167c3d48e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:48.945530 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e6487-bc6b-4794-bd36-7a7167c3d48e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:48.969892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 101/205] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/role_assignments?user.id=d743bc996f2f489d8341e3ce991cfa69&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:49.036983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9f79b-6131-46ab-84a3-c5c458f1b170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:49.039358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9f79b-6131-46ab-84a3-c5c458f1b170 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:49.108585 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:49.179735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 105/206] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:59:49.185187 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e6487-bc6b-4794-bd36-7a7167c3d48e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:49.317655 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e6487-bc6b-4794-bd36-7a7167c3d48e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:49.358004 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb0d28-249a-42e6-8e39-fd2ee7656974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:49.359288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0d28-249a-42e6-8e39-fd2ee7656974 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:49.359779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0d28-249a-42e6-8e39-fd2ee7656974 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:49.360258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb0d28-249a-42e6-8e39-fd2ee7656974 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:49.361867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb0d28-249a-42e6-8e39-fd2ee7656974 None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:49.363659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb0d28-249a-42e6-8e39-fd2ee7656974 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:49.366434 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 102/207] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:49 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:49.371894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9f79b-6131-46ab-84a3-c5c458f1b170 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:49.497314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9f79b-6131-46ab-84a3-c5c458f1b170 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:49.530837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce2dea-b761-4ea0-b196-90c6f844c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:49.531502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce2dea-b761-4ea0-b196-90c6f844c29b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:49.531788 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce2dea-b761-4ea0-b196-90c6f844c29b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:49.532063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce2dea-b761-4ea0-b196-90c6f844c29b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:49.532933 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce2dea-b761-4ea0-b196-90c6f844c29b None admin] RBAC: Adding query filter params (role.id=bee6c92a21d64b28b852f8719be02e65, scope.project.id=9f140c317e2e4605b3c3ef8420147900, user.id=3a97abd494c449669359c9f2360faab6) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:49.533247 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce2dea-b761-4ea0-b196-90c6f844c29b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:49.534962 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce2dea-b761-4ea0-b196-90c6f844c29b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:49.542336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 106/208] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:49 2022] GET /identity/v3/role_assignments?user.id=3a97abd494c449669359c9f2360faab6&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=bee6c92a21d64b28b852f8719be02e65 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:50.261689 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e58ddc-d4ae-46b9-9cee-2a3a8d6e6c9a None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:50.262398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e58ddc-d4ae-46b9-9cee-2a3a8d6e6c9a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:50.262918 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e58ddc-d4ae-46b9-9cee-2a3a8d6e6c9a None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:50.264875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 103/209] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:50.270394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eceba1a-c55f-4a99-a384-9d276d13cb1b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:50.270923 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eceba1a-c55f-4a99-a384-9d276d13cb1b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:50.271429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eceba1a-c55f-4a99-a384-9d276d13cb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:50.291048 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3eceba1a-c55f-4a99-a384-9d276d13cb1b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:50.292687 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3eceba1a-c55f-4a99-a384-9d276d13cb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:50.295879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:50.368551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 107/210] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:50.393977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e58ddc-d4ae-46b9-9cee-2a3a8d6e6c9a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:50.412109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:50.446706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcd964-afd1-4f50-a8d9-4c70e7d961ec None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:50.447331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcd964-afd1-4f50-a8d9-4c70e7d961ec None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:50.447814 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcd964-afd1-4f50-a8d9-4c70e7d961ec None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:50.449582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 108/211] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:50.457343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ffa8-0a71-487c-b985-93ffc51bb15e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:50.457910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ffa8-0a71-487c-b985-93ffc51bb15e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:50.458396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ffa8-0a71-487c-b985-93ffc51bb15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:50.476482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c4b9ffa8-0a71-487c-b985-93ffc51bb15e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:50.478217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c4b9ffa8-0a71-487c-b985-93ffc51bb15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:50.508969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e58ddc-d4ae-46b9-9cee-2a3a8d6e6c9a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:50.544852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a09b1-ba89-4c92-95e9-65878775f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:50.545569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a09b1-ba89-4c92-95e9-65878775f67b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:50.545853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a09b1-ba89-4c92-95e9-65878775f67b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:50.546127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a09b1-ba89-4c92-95e9-65878775f67b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:50.559754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a09b1-ba89-4c92-95e9-65878775f67b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:50.561247 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 109/212] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-996a09b1-ba89-4c92-95e9-65878775f67b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:50.569132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:50.569985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:50.570814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 104/213] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:50.577903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a09b1-ba89-4c92-95e9-65878775f67b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:50.593433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9ffa8-0a71-487c-b985-93ffc51bb15e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:50.668248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:50.678874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:50.700847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9ffa8-0a71-487c-b985-93ffc51bb15e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:50.705835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a09b1-ba89-4c92-95e9-65878775f67b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:50.738607 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae456904-ebbe-44c1-855c-3bbec72b19e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:50.739399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae456904-ebbe-44c1-855c-3bbec72b19e3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:50.739682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae456904-ebbe-44c1-855c-3bbec72b19e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:50.739953 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae456904-ebbe-44c1-855c-3bbec72b19e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:50.742321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae456904-ebbe-44c1-855c-3bbec72b19e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:50.742829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae1715-4ac6-4631-ab07-8b76d634a33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:50.743506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae1715-4ac6-4631-ab07-8b76d634a33b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:50.743790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae456904-ebbe-44c1-855c-3bbec72b19e3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:50.743895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae1715-4ac6-4631-ab07-8b76d634a33b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:50.744069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae1715-4ac6-4631-ab07-8b76d634a33b None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:50.744853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae1715-4ac6-4631-ab07-8b76d634a33b None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:50.745165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae1715-4ac6-4631-ab07-8b76d634a33b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:50.746543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae1715-4ac6-4631-ab07-8b76d634a33b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:50.750023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 110/214] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:50.751347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde4a6-6abb-4451-ab38-d292102e7424 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:50.751634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde4a6-6abb-4451-ab38-d292102e7424 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:50.751908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde4a6-6abb-4451-ab38-d292102e7424 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:50.753417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 111/215] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:50.753925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde4a6-6abb-4451-ab38-d292102e7424 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:50.760314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 105/216] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:50.762016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc7e6-4923-4037-8419-199cd665a0ca None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:50.762551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc7e6-4923-4037-8419-199cd665a0ca None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:50.763465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc7e6-4923-4037-8419-199cd665a0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:50.781035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4e3cc7e6-4923-4037-8419-199cd665a0ca None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:50.782237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4e3cc7e6-4923-4037-8419-199cd665a0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:50.857077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 106/217] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:50.863967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde4a6-6abb-4451-ab38-d292102e7424 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:50.869580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc7e6-4923-4037-8419-199cd665a0ca None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:50.902831 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891d337-9bea-4eef-a8c9-1d3dcd0570dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:50.903512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891d337-9bea-4eef-a8c9-1d3dcd0570dc None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:50.903847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891d337-9bea-4eef-a8c9-1d3dcd0570dc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:50.904137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891d337-9bea-4eef-a8c9-1d3dcd0570dc None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:50.904918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891d337-9bea-4eef-a8c9-1d3dcd0570dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:50.906362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891d337-9bea-4eef-a8c9-1d3dcd0570dc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:50.916580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:50.937611 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 112/218] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:50 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:59:50.939264 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891d337-9bea-4eef-a8c9-1d3dcd0570dc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:50.950414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:50.992862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc7e6-4923-4037-8419-199cd665a0ca None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.045497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce169f6f-7737-4923-b660-25b177cb9e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.047495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce169f6f-7737-4923-b660-25b177cb9e5b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.048249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce169f6f-7737-4923-b660-25b177cb9e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.048713 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce169f6f-7737-4923-b660-25b177cb9e5b None admin] PATH_INFO: `/v3/users/ed27c604eb624e988e2853c0caba3a8a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.070768 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce169f6f-7737-4923-b660-25b177cb9e5b None admin] RBAC: Authorizing `identity:get_user(user_id=ed27c604eb624e988e2853c0caba3a8a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:51.074129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce169f6f-7737-4923-b660-25b177cb9e5b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:51.080489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 107/219] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:50 2022] GET /identity/v3/users/ed27c604eb624e988e2853c0caba3a8a => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:51.083311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce169f6f-7737-4923-b660-25b177cb9e5b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.096792 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891d337-9bea-4eef-a8c9-1d3dcd0570dc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.143932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea49a38-2671-4cfc-b89e-f8b31e5fe476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.144827 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea49a38-2671-4cfc-b89e-f8b31e5fe476 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.145185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea49a38-2671-4cfc-b89e-f8b31e5fe476 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.145530 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea49a38-2671-4cfc-b89e-f8b31e5fe476 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.157445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea49a38-2671-4cfc-b89e-f8b31e5fe476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-fea49a38-2671-4cfc-b89e-f8b31e5fe476 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:51.167332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:51.168249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:51.169075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 113/220] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:51.175926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea49a38-2671-4cfc-b89e-f8b31e5fe476 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.223125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce169f6f-7737-4923-b660-25b177cb9e5b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.253901 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:51.257050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:51.272999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b24b9b-cfce-4c56-8ef1-3005dd847155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.274158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b24b9b-cfce-4c56-8ef1-3005dd847155 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.274265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b24b9b-cfce-4c56-8ef1-3005dd847155 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.274472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b24b9b-cfce-4c56-8ef1-3005dd847155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.316070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea49a38-2671-4cfc-b89e-f8b31e5fe476 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.363071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3c42f-05d0-42f6-8201-1e8fa8cfc9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.363914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3c42f-05d0-42f6-8201-1e8fa8cfc9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.364311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3c42f-05d0-42f6-8201-1e8fa8cfc9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.364684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b24b9b-cfce-4c56-8ef1-3005dd847155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:51.364791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3c42f-05d0-42f6-8201-1e8fa8cfc9b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.366518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3c42f-05d0-42f6-8201-1e8fa8cfc9b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:51.366703 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b24b9b-cfce-4c56-8ef1-3005dd847155 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:51.366950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3c42f-05d0-42f6-8201-1e8fa8cfc9b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:51.368420 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3c42f-05d0-42f6-8201-1e8fa8cfc9b2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:51.382748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 114/221] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:51.388308 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749cbf7-8514-4a02-a7fb-48841efd59ae None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.388603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749cbf7-8514-4a02-a7fb-48841efd59ae None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.388904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749cbf7-8514-4a02-a7fb-48841efd59ae None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.390291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 115/222] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:51.394466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749cbf7-8514-4a02-a7fb-48841efd59ae None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.497791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 108/223] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:59:51.498939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02c218-9bab-4cf8-a9b7-79b22f49dda4 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.499232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02c218-9bab-4cf8-a9b7-79b22f49dda4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.499514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02c218-9bab-4cf8-a9b7-79b22f49dda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.510504 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749cbf7-8514-4a02-a7fb-48841efd59ae None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.517306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0d02c218-9bab-4cf8-a9b7-79b22f49dda4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:51.518613 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0d02c218-9bab-4cf8-a9b7-79b22f49dda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:51.529149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:51.540926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:51.552455 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b6649-d9b8-4ca1-855a-a8221caf0a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.554259 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b6649-d9b8-4ca1-855a-a8221caf0a71 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.554608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b6649-d9b8-4ca1-855a-a8221caf0a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.554890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b6649-d9b8-4ca1-855a-a8221caf0a71 None admin] PATH_INFO: `/v3/users/d743bc996f2f489d8341e3ce991cfa69` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.556347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b6649-d9b8-4ca1-855a-a8221caf0a71 None admin] RBAC: Authorizing `identity:get_user(user_id=d743bc996f2f489d8341e3ce991cfa69)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:51.557873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b6649-d9b8-4ca1-855a-a8221caf0a71 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:51.559877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 116/224] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/users/d743bc996f2f489d8341e3ce991cfa69 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:51.565037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b6649-d9b8-4ca1-855a-a8221caf0a71 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.596674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 109/225] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:51.597616 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02c218-9bab-4cf8-a9b7-79b22f49dda4 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.694106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b6649-d9b8-4ca1-855a-a8221caf0a71 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.709084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02c218-9bab-4cf8-a9b7-79b22f49dda4 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.741675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794da1e1-b9da-4289-860f-6c0ad6b8722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.742830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794da1e1-b9da-4289-860f-6c0ad6b8722a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.743119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794da1e1-b9da-4289-860f-6c0ad6b8722a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.743837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794da1e1-b9da-4289-860f-6c0ad6b8722a None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.745358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794da1e1-b9da-4289-860f-6c0ad6b8722a None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:51.747731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794da1e1-b9da-4289-860f-6c0ad6b8722a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:51.749510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 117/226] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:51.750281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794da1e1-b9da-4289-860f-6c0ad6b8722a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.751241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524bf8a-20d8-4ad7-a940-63b99b574045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.752118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524bf8a-20d8-4ad7-a940-63b99b574045 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.752440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524bf8a-20d8-4ad7-a940-63b99b574045 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.752866 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524bf8a-20d8-4ad7-a940-63b99b574045 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.754227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524bf8a-20d8-4ad7-a940-63b99b574045 None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:51.755933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524bf8a-20d8-4ad7-a940-63b99b574045 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:51.758433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 110/227] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:51.759207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524bf8a-20d8-4ad7-a940-63b99b574045 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.790725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:51.809466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:51.857995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794da1e1-b9da-4289-860f-6c0ad6b8722a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.880772 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524bf8a-20d8-4ad7-a940-63b99b574045 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:51.892547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb5f1-8ae9-40ac-b947-b3c3f15b2a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.893411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb5f1-8ae9-40ac-b947-b3c3f15b2a2f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.893701 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb5f1-8ae9-40ac-b947-b3c3f15b2a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.893985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb5f1-8ae9-40ac-b947-b3c3f15b2a2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.905314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefb5f1-8ae9-40ac-b947-b3c3f15b2a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-0fefb5f1-8ae9-40ac-b947-b3c3f15b2a2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:51.914008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:51.915099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 118/228] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:51.916058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb5f1-8ae9-40ac-b947-b3c3f15b2a2f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:51.926103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34b118-904f-4a34-b231-407e31b39a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:51.927051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34b118-904f-4a34-b231-407e31b39a2a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:51.927498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34b118-904f-4a34-b231-407e31b39a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:51.928453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34b118-904f-4a34-b231-407e31b39a2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:51.930200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34b118-904f-4a34-b231-407e31b39a2a None admin] RBAC: Adding query filter params (role.id=f5a5bdf6fee0438391dd54c5b545305e, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a, user.id=ed27c604eb624e988e2853c0caba3a8a) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:51.930707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34b118-904f-4a34-b231-407e31b39a2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:51.932437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34b118-904f-4a34-b231-407e31b39a2a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:51.939479 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 111/229] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/role_assignments?user.id=ed27c604eb624e988e2853c0caba3a8a&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:51.940438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34b118-904f-4a34-b231-407e31b39a2a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:52.048175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb5f1-8ae9-40ac-b947-b3c3f15b2a2f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:52.048639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:52.068522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34b118-904f-4a34-b231-407e31b39a2a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:52.075811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:52.111622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f7e0d-4881-4f4f-ab57-e5bf319b5b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:52.112563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7e0d-4881-4f4f-ab57-e5bf319b5b58 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:52.113132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7e0d-4881-4f4f-ab57-e5bf319b5b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:52.113557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f7e0d-4881-4f4f-ab57-e5bf319b5b58 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:52.114710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f7e0d-4881-4f4f-ab57-e5bf319b5b58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:52.115279 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f7e0d-4881-4f4f-ab57-e5bf319b5b58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:52.117732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f7e0d-4881-4f4f-ab57-e5bf319b5b58 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:52.122062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b7a24-d99d-4732-8975-2a8338607eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:52.122994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b7a24-d99d-4732-8975-2a8338607eee None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:52.123281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b7a24-d99d-4732-8975-2a8338607eee None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:52.123563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b7a24-d99d-4732-8975-2a8338607eee None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/users/d743bc996f2f489d8341e3ce991cfa69/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:52.128927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 112/230] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:52.130385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b7a24-d99d-4732-8975-2a8338607eee None admin] RBAC: Authorizing `identity:create_grant(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a, user_id=d743bc996f2f489d8341e3ce991cfa69, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:52.131937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b7a24-d99d-4732-8975-2a8338607eee None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:52.141678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f7e0d-4881-4f4f-ab57-e5bf319b5b58 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:52.151757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 119/231] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:51 2022] PUT /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/users/d743bc996f2f489d8341e3ce991cfa69/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:52.316266 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f7e0d-4881-4f4f-ab57-e5bf319b5b58 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:52.372139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b189e-0dc4-49ae-b948-3043354b974a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:52.373088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b189e-0dc4-49ae-b948-3043354b974a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:52.373377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b189e-0dc4-49ae-b948-3043354b974a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:52.373659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b189e-0dc4-49ae-b948-3043354b974a None admin] PATH_INFO: `/v3/users/d743bc996f2f489d8341e3ce991cfa69` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:52.375117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b189e-0dc4-49ae-b948-3043354b974a None admin] RBAC: Authorizing `identity:get_user(user_id=d743bc996f2f489d8341e3ce991cfa69)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:52.376476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b189e-0dc4-49ae-b948-3043354b974a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:52.378603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 113/232] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:52 2022] GET /identity/v3/users/d743bc996f2f489d8341e3ce991cfa69 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:52.384795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b7a24-d99d-4732-8975-2a8338607eee None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:52.522105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b7a24-d99d-4732-8975-2a8338607eee None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:52.566250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2839d-e0f5-4ca3-a356-8f20b4585ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:52.567195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2839d-e0f5-4ca3-a356-8f20b4585ada None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:52.567428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2839d-e0f5-4ca3-a356-8f20b4585ada None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:52.567707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2839d-e0f5-4ca3-a356-8f20b4585ada None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:52.569352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2839d-e0f5-4ca3-a356-8f20b4585ada None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:52.570901 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2839d-e0f5-4ca3-a356-8f20b4585ada None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:52.572959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 120/233] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:52 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:52.578501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b189e-0dc4-49ae-b948-3043354b974a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:52.614006 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:52.773346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b189e-0dc4-49ae-b948-3043354b974a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:52.825025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c928cd5-58bd-46d1-90ef-87d09e85bdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:52.825849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c928cd5-58bd-46d1-90ef-87d09e85bdc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:52.826138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c928cd5-58bd-46d1-90ef-87d09e85bdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:52.826418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c928cd5-58bd-46d1-90ef-87d09e85bdc0 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/users/d743bc996f2f489d8341e3ce991cfa69/roles/0af0bb9954e74b6c9158c0ea76a2c7a5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:52.828733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c928cd5-58bd-46d1-90ef-87d09e85bdc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a, user_id=d743bc996f2f489d8341e3ce991cfa69, role_id=0af0bb9954e74b6c9158c0ea76a2c7a5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:52.830201 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c928cd5-58bd-46d1-90ef-87d09e85bdc0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:52.857307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 114/234] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:52 2022] PUT /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/users/d743bc996f2f489d8341e3ce991cfa69/roles/0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:53.539092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0f45-e334-4878-87e4-307085329f3e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:53.539807 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0f45-e334-4878-87e4-307085329f3e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:53.540300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0f45-e334-4878-87e4-307085329f3e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:53.542194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 121/235] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:53.547074 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320e513-ef9b-4f43-b6ce-1152ed41a201 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:53.547622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320e513-ef9b-4f43-b6ce-1152ed41a201 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:53.548134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320e513-ef9b-4f43-b6ce-1152ed41a201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:53.565543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1320e513-ef9b-4f43-b6ce-1152ed41a201 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:53.567048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1320e513-ef9b-4f43-b6ce-1152ed41a201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:53.649461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 115/236] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:53.681032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e0f45-e334-4878-87e4-307085329f3e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:53.700947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487fe1b-a4e2-4dfb-8b62-f1509caf562a None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:53.701246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487fe1b-a4e2-4dfb-8b62-f1509caf562a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:53.701524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487fe1b-a4e2-4dfb-8b62-f1509caf562a None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:53.703100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 116/237] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:53.717114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87620af1-4a18-45f2-b5ae-c13d66b0a20c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:53.717409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87620af1-4a18-45f2-b5ae-c13d66b0a20c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:53.717691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87620af1-4a18-45f2-b5ae-c13d66b0a20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:53.736932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:53.739468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:53.745856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-87620af1-4a18-45f2-b5ae-c13d66b0a20c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:53.747153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-87620af1-4a18-45f2-b5ae-c13d66b0a20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:53.800196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e0f45-e334-4878-87e4-307085329f3e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:53.835570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5af7-10c1-45f7-b1ec-2303081ec7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:53.836448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5af7-10c1-45f7-b1ec-2303081ec7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:53.836798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5af7-10c1-45f7-b1ec-2303081ec7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:53.837079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5af7-10c1-45f7-b1ec-2303081ec7a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:53.848213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf5af7-10c1-45f7-b1ec-2303081ec7a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6bcf5af7-10c1-45f7-b1ec-2303081ec7a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:53.856959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:53.857877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:53.858870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 122/238] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:53.865811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5af7-10c1-45f7-b1ec-2303081ec7a2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:53.911782 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 117/239] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:53.957992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87620af1-4a18-45f2-b5ae-c13d66b0a20c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:54.046770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:54.055160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5af7-10c1-45f7-b1ec-2303081ec7a2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:54.125867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c79bcc-58b4-4cc7-9e4f-a3e029c85235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:54.126550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79bcc-58b4-4cc7-9e4f-a3e029c85235 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.126832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79bcc-58b4-4cc7-9e4f-a3e029c85235 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.127110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79bcc-58b4-4cc7-9e4f-a3e029c85235 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.127865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c79bcc-58b4-4cc7-9e4f-a3e029c85235 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:54.128173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c79bcc-58b4-4cc7-9e4f-a3e029c85235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:54.129601 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c79bcc-58b4-4cc7-9e4f-a3e029c85235 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:54.148870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 123/240] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:54.154669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c79bcc-58b4-4cc7-9e4f-a3e029c85235 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:54.156032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87620af1-4a18-45f2-b5ae-c13d66b0a20c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:54.205529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0d9d9-c6a1-42d2-a25f-7c5aaccd05a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:54.206495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d9d9-c6a1-42d2-a25f-7c5aaccd05a1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.207053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d9d9-c6a1-42d2-a25f-7c5aaccd05a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.207342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d9d9-c6a1-42d2-a25f-7c5aaccd05a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.208525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0d9d9-c6a1-42d2-a25f-7c5aaccd05a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:54.210723 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0d9d9-c6a1-42d2-a25f-7c5aaccd05a1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:54.212850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 118/241] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:54.218555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0d9d9-c6a1-42d2-a25f-7c5aaccd05a1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:54.232969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:54.331508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0d9d9-c6a1-42d2-a25f-7c5aaccd05a1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:54.370928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861779e-2108-4d19-a899-f2d9491a713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:54.371652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861779e-2108-4d19-a899-f2d9491a713e None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.371939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861779e-2108-4d19-a899-f2d9491a713e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.372216 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861779e-2108-4d19-a899-f2d9491a713e None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.372966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861779e-2108-4d19-a899-f2d9491a713e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:54.374779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861779e-2108-4d19-a899-f2d9491a713e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:54.397746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 119/242] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:54 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:54.445379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95155d6e-aac7-4ecd-9c62-b601072b5f17 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.446330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95155d6e-aac7-4ecd-9c62-b601072b5f17 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.446615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95155d6e-aac7-4ecd-9c62-b601072b5f17 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.448762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 120/243] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:54.454042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8258f-b2b3-4525-bb75-25911e997831 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.454431 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8258f-b2b3-4525-bb75-25911e997831 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.454770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8258f-b2b3-4525-bb75-25911e997831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.476565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6ae8258f-b2b3-4525-bb75-25911e997831 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:54.478255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6ae8258f-b2b3-4525-bb75-25911e997831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:54.489055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c79bcc-58b4-4cc7-9e4f-a3e029c85235 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:54.553114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:54.564868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 121/244] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:54.589133 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485df990-4a7e-4837-978a-313224ba165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:54.589954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485df990-4a7e-4837-978a-313224ba165b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.590240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485df990-4a7e-4837-978a-313224ba165b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.590518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485df990-4a7e-4837-978a-313224ba165b None admin] PATH_INFO: `/v3/users/8198a33cf9614bbe90d032ef7a9d850f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.607394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8258f-b2b3-4525-bb75-25911e997831 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:54.620271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485df990-4a7e-4837-978a-313224ba165b None admin] RBAC: Authorizing `identity:get_user(user_id=8198a33cf9614bbe90d032ef7a9d850f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:54.622075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485df990-4a7e-4837-978a-313224ba165b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:54.623981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 124/245] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:54 2022] GET /identity/v3/users/8198a33cf9614bbe90d032ef7a9d850f => generated 297 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:54.637278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485df990-4a7e-4837-978a-313224ba165b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:54.661694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:54.721325 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8258f-b2b3-4525-bb75-25911e997831 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:54.751723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485df990-4a7e-4837-978a-313224ba165b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:54.761971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78254759-1038-4a58-981a-dc24134a8be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:54.763084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78254759-1038-4a58-981a-dc24134a8be6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.763567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78254759-1038-4a58-981a-dc24134a8be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.764060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78254759-1038-4a58-981a-dc24134a8be6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.777436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78254759-1038-4a58-981a-dc24134a8be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-78254759-1038-4a58-981a-dc24134a8be6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:54.787336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:54.788285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:54.789604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:54.790223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34dce3-765d-415f-ae0a-a1ab9a338609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:54.790223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34dce3-765d-415f-ae0a-a1ab9a338609 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.790658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34dce3-765d-415f-ae0a-a1ab9a338609 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.790658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34dce3-765d-415f-ae0a-a1ab9a338609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.792334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 122/246] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:54.799889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78254759-1038-4a58-981a-dc24134a8be6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:54.864947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:54.882136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34dce3-765d-415f-ae0a-a1ab9a338609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:54.884069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34dce3-765d-415f-ae0a-a1ab9a338609 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:54.908217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:54.929529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78254759-1038-4a58-981a-dc24134a8be6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:54.971530 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a771b-18bc-4615-a8f0-e9b9c46eff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:54.972215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a771b-18bc-4615-a8f0-e9b9c46eff23 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.972506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a771b-18bc-4615-a8f0-e9b9c46eff23 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.972864 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a771b-18bc-4615-a8f0-e9b9c46eff23 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.973635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a771b-18bc-4615-a8f0-e9b9c46eff23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:54.973942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a771b-18bc-4615-a8f0-e9b9c46eff23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:54.975403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a771b-18bc-4615-a8f0-e9b9c46eff23 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:54.987248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 123/247] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:54.988694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da4a71-65dd-42fd-9867-705b9a500251 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:54.988988 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da4a71-65dd-42fd-9867-705b9a500251 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:54.989269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da4a71-65dd-42fd-9867-705b9a500251 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:54.991093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 124/248] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:54.993450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da4a71-65dd-42fd-9867-705b9a500251 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:55.020885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 125/249] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:59:55.022698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb316ad-3fd2-43b9-b2cc-825f45bb610e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.023240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb316ad-3fd2-43b9-b2cc-825f45bb610e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.023783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb316ad-3fd2-43b9-b2cc-825f45bb610e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.045242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2fb316ad-3fd2-43b9-b2cc-825f45bb610e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:55.046768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2fb316ad-3fd2-43b9-b2cc-825f45bb610e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:55.149351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 126/250] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:55.149351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb316ad-3fd2-43b9-b2cc-825f45bb610e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:55.157999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da4a71-65dd-42fd-9867-705b9a500251 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.199748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:55.232640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b1331-cc76-4999-a0f1-b756a2413065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:55.233534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b1331-cc76-4999-a0f1-b756a2413065 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.233820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b1331-cc76-4999-a0f1-b756a2413065 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.234098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b1331-cc76-4999-a0f1-b756a2413065 None admin] PATH_INFO: `/v3/users/ed27c604eb624e988e2853c0caba3a8a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.235409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b1331-cc76-4999-a0f1-b756a2413065 None admin] RBAC: Authorizing `identity:get_user(user_id=ed27c604eb624e988e2853c0caba3a8a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:55.237837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b1331-cc76-4999-a0f1-b756a2413065 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:55.239495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 125/251] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:54 2022] GET /identity/v3/users/ed27c604eb624e988e2853c0caba3a8a => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:55.248208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b1331-cc76-4999-a0f1-b756a2413065 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:55.253011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:55.345275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb316ad-3fd2-43b9-b2cc-825f45bb610e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.369207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b1331-cc76-4999-a0f1-b756a2413065 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.387304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fccb5-d820-44c9-b756-412c90d66324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:55.388321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fccb5-d820-44c9-b756-412c90d66324 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.388736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fccb5-d820-44c9-b756-412c90d66324 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.389113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fccb5-d820-44c9-b756-412c90d66324 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.390405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fccb5-d820-44c9-b756-412c90d66324 None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:55.391973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fccb5-d820-44c9-b756-412c90d66324 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:55.393819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 127/252] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:55 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:55.394675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fccb5-d820-44c9-b756-412c90d66324 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:55.406784 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e059cb8-9a38-4a23-bc00-48847078dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:55.407610 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059cb8-9a38-4a23-bc00-48847078dd14 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.407902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059cb8-9a38-4a23-bc00-48847078dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.408182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059cb8-9a38-4a23-bc00-48847078dd14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.420646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e059cb8-9a38-4a23-bc00-48847078dd14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-9e059cb8-9a38-4a23-bc00-48847078dd14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:55.430248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:55.431217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:55.432712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 126/253] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 05:59:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:55.434159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6d83-30f8-4ac5-8d53-c581f39574b5 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.434159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6d83-30f8-4ac5-8d53-c581f39574b5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.434159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a6d83-30f8-4ac5-8d53-c581f39574b5 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.435565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 127/254] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:55.436317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a6d83-30f8-4ac5-8d53-c581f39574b5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:55.504561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fccb5-d820-44c9-b756-412c90d66324 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.524742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:55.526574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:55.547789 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c3700-5a63-40dc-b504-b81273169a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:55.548841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c3700-5a63-40dc-b504-b81273169a15 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.549292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c3700-5a63-40dc-b504-b81273169a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.549642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c3700-5a63-40dc-b504-b81273169a15 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.551138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c3700-5a63-40dc-b504-b81273169a15 None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:55.553361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c3700-5a63-40dc-b504-b81273169a15 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:55.555279 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 128/255] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:55 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:55.556551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fe1bd-026b-40ad-a98f-82af97549bd6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.557044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fe1bd-026b-40ad-a98f-82af97549bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.557395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fe1bd-026b-40ad-a98f-82af97549bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.561846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a6d83-30f8-4ac5-8d53-c581f39574b5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.575322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-cc1fe1bd-026b-40ad-a98f-82af97549bd6 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:55.576684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cc1fe1bd-026b-40ad-a98f-82af97549bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:55.605833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c554-c269-4d2a-bc94-85d4e3f62a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:55.606519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c554-c269-4d2a-bc94-85d4e3f62a68 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.606914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c554-c269-4d2a-bc94-85d4e3f62a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.607264 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c554-c269-4d2a-bc94-85d4e3f62a68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.608224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c554-c269-4d2a-bc94-85d4e3f62a68 None admin] RBAC: Adding query filter params (role.id=bee6c92a21d64b28b852f8719be02e65, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a, user.id=8198a33cf9614bbe90d032ef7a9d850f) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:55.608623 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c554-c269-4d2a-bc94-85d4e3f62a68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:55.610248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c554-c269-4d2a-bc94-85d4e3f62a68 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:55.624638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 128/256] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:55 2022] GET /identity/v3/role_assignments?user.id=8198a33cf9614bbe90d032ef7a9d850f&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=bee6c92a21d64b28b852f8719be02e65 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:55.624638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c554-c269-4d2a-bc94-85d4e3f62a68 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:55.702838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 129/257] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:55.703665 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fe1bd-026b-40ad-a98f-82af97549bd6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:55.788511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c554-c269-4d2a-bc94-85d4e3f62a68 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.791246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:55.829210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc80803-7e06-4ee3-9999-da6952ca13b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:55.829898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc80803-7e06-4ee3-9999-da6952ca13b0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.830189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc80803-7e06-4ee3-9999-da6952ca13b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.830471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc80803-7e06-4ee3-9999-da6952ca13b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.831247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc80803-7e06-4ee3-9999-da6952ca13b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:55.831562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc80803-7e06-4ee3-9999-da6952ca13b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:55.833045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc80803-7e06-4ee3-9999-da6952ca13b0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:55.843213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 129/258] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:55.843868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc80803-7e06-4ee3-9999-da6952ca13b0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:55.900261 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fe1bd-026b-40ad-a98f-82af97549bd6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.929010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:55.953061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc80803-7e06-4ee3-9999-da6952ca13b0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:55.975719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eef55-68bd-4272-9017-66266bc92844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:55.976639 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eef55-68bd-4272-9017-66266bc92844 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:55.976937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eef55-68bd-4272-9017-66266bc92844 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:55.977219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eef55-68bd-4272-9017-66266bc92844 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/users/ed27c604eb624e988e2853c0caba3a8a/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:55.979218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eef55-68bd-4272-9017-66266bc92844 None admin] RBAC: Authorizing `identity:create_grant(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a, user_id=ed27c604eb624e988e2853c0caba3a8a, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:55.980729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eef55-68bd-4272-9017-66266bc92844 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:56.000134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 130/259] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:55 2022] PUT /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/users/ed27c604eb624e988e2853c0caba3a8a/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:56.001019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eef55-68bd-4272-9017-66266bc92844 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:56.041522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284c9d2-56db-4498-bb27-7f997c20c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:56.044443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284c9d2-56db-4498-bb27-7f997c20c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:56.044801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284c9d2-56db-4498-bb27-7f997c20c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:56.045086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284c9d2-56db-4498-bb27-7f997c20c0f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:56.073661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284c9d2-56db-4498-bb27-7f997c20c0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-2284c9d2-56db-4498-bb27-7f997c20c0f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:56.091332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:56.092299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:59:56.093287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:56.094682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 130/260] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 05:59:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:56.103503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284c9d2-56db-4498-bb27-7f997c20c0f3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:56.197073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:56.263113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eef55-68bd-4272-9017-66266bc92844 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:56.310875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326dd9a-137f-4326-b53c-024039dd0f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:56.311766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326dd9a-137f-4326-b53c-024039dd0f72 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:56.312052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326dd9a-137f-4326-b53c-024039dd0f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:56.312337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326dd9a-137f-4326-b53c-024039dd0f72 None admin] PATH_INFO: `/v3/users/d743bc996f2f489d8341e3ce991cfa69` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:56.314925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326dd9a-137f-4326-b53c-024039dd0f72 None admin] RBAC: Authorizing `identity:get_user(user_id=d743bc996f2f489d8341e3ce991cfa69)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:56.316403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326dd9a-137f-4326-b53c-024039dd0f72 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:56.323212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 131/261] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:56 2022] GET /identity/v3/users/d743bc996f2f489d8341e3ce991cfa69 => generated 283 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:56.325173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326dd9a-137f-4326-b53c-024039dd0f72 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:56.353448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284c9d2-56db-4498-bb27-7f997c20c0f3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:56.389686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:56.443417 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fa8e9-aa8d-4dd0-b806-e594f18b3bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:56.444107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fa8e9-aa8d-4dd0-b806-e594f18b3bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:56.444395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fa8e9-aa8d-4dd0-b806-e594f18b3bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:56.444709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fa8e9-aa8d-4dd0-b806-e594f18b3bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:56.445465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fa8e9-aa8d-4dd0-b806-e594f18b3bf5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:56.445781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fa8e9-aa8d-4dd0-b806-e594f18b3bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:56.447187 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fa8e9-aa8d-4dd0-b806-e594f18b3bf5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:56.464728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 131/262] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 05:59:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:56.470079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fa8e9-aa8d-4dd0-b806-e594f18b3bf5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:56.493097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326dd9a-137f-4326-b53c-024039dd0f72 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:56.567835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f962c57-d320-4bee-83bf-abea9b4f86a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:56.569000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f962c57-d320-4bee-83bf-abea9b4f86a5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:56.569332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f962c57-d320-4bee-83bf-abea9b4f86a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:56.569587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f962c57-d320-4bee-83bf-abea9b4f86a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:56.652990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:56.681016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fa8e9-aa8d-4dd0-b806-e594f18b3bf5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:56.703213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f962c57-d320-4bee-83bf-abea9b4f86a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:56.704741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f962c57-d320-4bee-83bf-abea9b4f86a5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:56.757769 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c97b5-79d6-4db8-81bc-e2e98e4300fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:56.758668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c97b5-79d6-4db8-81bc-e2e98e4300fa None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:56.758950 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c97b5-79d6-4db8-81bc-e2e98e4300fa None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:56.759223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c97b5-79d6-4db8-81bc-e2e98e4300fa None admin] PATH_INFO: `/v3/users/d743bc996f2f489d8341e3ce991cfa69` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:56.761395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c97b5-79d6-4db8-81bc-e2e98e4300fa None admin] RBAC: Authorizing `identity:get_user(user_id=d743bc996f2f489d8341e3ce991cfa69)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:56.763456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c97b5-79d6-4db8-81bc-e2e98e4300fa None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:56.765496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 132/263] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:56 2022] GET /identity/v3/users/d743bc996f2f489d8341e3ce991cfa69 => generated 283 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:56.770871 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c97b5-79d6-4db8-81bc-e2e98e4300fa None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:56.865814 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:56.922764 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 132/264] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:59:56.929715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f962c57-d320-4bee-83bf-abea9b4f86a5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:56.945772 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c97b5-79d6-4db8-81bc-e2e98e4300fa None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:57.007049 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb771513-b6eb-4a49-96f9-69995090c9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:57.007763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb771513-b6eb-4a49-96f9-69995090c9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.008064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb771513-b6eb-4a49-96f9-69995090c9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.008348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb771513-b6eb-4a49-96f9-69995090c9a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.051253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:57.061648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f962c57-d320-4bee-83bf-abea9b4f86a5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:57.098951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b57878-1892-4781-9862-1255def54e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:57.100825 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57878-1892-4781-9862-1255def54e98 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.101319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57878-1892-4781-9862-1255def54e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.101792 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57878-1892-4781-9862-1255def54e98 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.103312 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b57878-1892-4781-9862-1255def54e98 None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:57.105009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b57878-1892-4781-9862-1255def54e98 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:57.106967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 133/265] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:56 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:57.117791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b57878-1892-4781-9862-1255def54e98 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:57.133352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:57.135162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb771513-b6eb-4a49-96f9-69995090c9a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:57.136760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb771513-b6eb-4a49-96f9-69995090c9a0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:57.227227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b57878-1892-4781-9862-1255def54e98 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:57.273376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdbeaa-220f-4bd3-afc0-9e9412811c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:57.274429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdbeaa-220f-4bd3-afc0-9e9412811c85 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.274941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdbeaa-220f-4bd3-afc0-9e9412811c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.275418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdbeaa-220f-4bd3-afc0-9e9412811c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.276478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdbeaa-220f-4bd3-afc0-9e9412811c85 None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a, user.id=d743bc996f2f489d8341e3ce991cfa69) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:57.277017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdbeaa-220f-4bd3-afc0-9e9412811c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:57.278675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdbeaa-220f-4bd3-afc0-9e9412811c85 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:57.286010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 134/266] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:57 2022] GET /identity/v3/role_assignments?user.id=d743bc996f2f489d8341e3ce991cfa69&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=efc16976111d431c9173186cbd0e6c24 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:57.331004 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 133/267] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 05:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:59:57.337928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdbeaa-220f-4bd3-afc0-9e9412811c85 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:57.350259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c89a05-2406-4e76-82f6-d3925a61753a None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.351017 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c89a05-2406-4e76-82f6-d3925a61753a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.351300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c89a05-2406-4e76-82f6-d3925a61753a None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.355491 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 134/268] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:57.362830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113ffe-4f74-4a58-924f-7a1a80ebe75d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.363124 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113ffe-4f74-4a58-924f-7a1a80ebe75d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.363388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113ffe-4f74-4a58-924f-7a1a80ebe75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.395203 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-33113ffe-4f74-4a58-924f-7a1a80ebe75d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:57.396360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-33113ffe-4f74-4a58-924f-7a1a80ebe75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:57.524199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:57.537650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:57.557899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdbeaa-220f-4bd3-afc0-9e9412811c85 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:57.560584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 135/269] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:57.561949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7bbf3-d6b8-423e-bf8a-55219b2f9b3d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.562238 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7bbf3-d6b8-423e-bf8a-55219b2f9b3d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.562522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7bbf3-d6b8-423e-bf8a-55219b2f9b3d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.569208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 136/270] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:57.574542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f946-ea61-48cf-9898-7eb4d7d3669c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.574836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f946-ea61-48cf-9898-7eb4d7d3669c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.575119 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f946-ea61-48cf-9898-7eb4d7d3669c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.595858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d77919-0da6-47c0-bab8-71b98036e26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:57.596762 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d77919-0da6-47c0-bab8-71b98036e26a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.597052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d77919-0da6-47c0-bab8-71b98036e26a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.597337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d77919-0da6-47c0-bab8-71b98036e26a None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.598546 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d77919-0da6-47c0-bab8-71b98036e26a None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:57.600166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d77919-0da6-47c0-bab8-71b98036e26a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:57.600894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-da01f946-ea61-48cf-9898-7eb4d7d3669c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:57.602085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 135/271] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:57 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:57.602370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-da01f946-ea61-48cf-9898-7eb4d7d3669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:57.608036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d77919-0da6-47c0-bab8-71b98036e26a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:57.681979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 137/272] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:57.682764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01f946-ea61-48cf-9898-7eb4d7d3669c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:57.737550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d77919-0da6-47c0-bab8-71b98036e26a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:57.779624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53417e0-7487-42e7-9988-ebccd47a892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:57.780817 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53417e0-7487-42e7-9988-ebccd47a892c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.781668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53417e0-7487-42e7-9988-ebccd47a892c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.782284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53417e0-7487-42e7-9988-ebccd47a892c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.783399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53417e0-7487-42e7-9988-ebccd47a892c None admin] RBAC: Adding query filter params (role.id=0af0bb9954e74b6c9158c0ea76a2c7a5, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a, user.id=d743bc996f2f489d8341e3ce991cfa69) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:57.784308 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53417e0-7487-42e7-9988-ebccd47a892c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:57.786254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53417e0-7487-42e7-9988-ebccd47a892c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:57.794710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 136/273] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 05:59:57 2022] GET /identity/v3/role_assignments?user.id=d743bc996f2f489d8341e3ce991cfa69&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:57.795879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53417e0-7487-42e7-9988-ebccd47a892c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:57.803505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01f946-ea61-48cf-9898-7eb4d7d3669c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:57.810329 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:57.825292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:57.852664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4fd11-9cce-470c-9704-29edc8eadbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:57.853606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4fd11-9cce-470c-9704-29edc8eadbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.853962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4fd11-9cce-470c-9704-29edc8eadbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.854366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4fd11-9cce-470c-9704-29edc8eadbe9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.856360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4fd11-9cce-470c-9704-29edc8eadbe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:57.858796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4fd11-9cce-470c-9704-29edc8eadbe9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:57.861175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 138/274] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 05:59:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:57.868758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4fd11-9cce-470c-9704-29edc8eadbe9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:57.923707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53417e0-7487-42e7-9988-ebccd47a892c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:57.963531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe4d99-4f23-4b7e-8893-f2fc52cd408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:57.964256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe4d99-4f23-4b7e-8893-f2fc52cd408a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:57.964548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe4d99-4f23-4b7e-8893-f2fc52cd408a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:57.964864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe4d99-4f23-4b7e-8893-f2fc52cd408a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:57.976856 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe4d99-4f23-4b7e-8893-f2fc52cd408a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-8ffe4d99-4f23-4b7e-8893-f2fc52cd408a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:57.984881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:57.985872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:57.986710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:57.987320 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4fd11-9cce-470c-9704-29edc8eadbe9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:57.987723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 137/275] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:57.995054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe4d99-4f23-4b7e-8893-f2fc52cd408a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:58.028102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209f610-0599-4f82-9dee-114387251dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:58.028838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209f610-0599-4f82-9dee-114387251dc3 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.029275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209f610-0599-4f82-9dee-114387251dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.029557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209f610-0599-4f82-9dee-114387251dc3 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.030295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209f610-0599-4f82-9dee-114387251dc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:58.031780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209f610-0599-4f82-9dee-114387251dc3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:58.057948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 139/276] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 05:59:57 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:59:58.119047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:58.163160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe4d99-4f23-4b7e-8893-f2fc52cd408a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:58.205222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff56d3-bdff-4079-813a-b0bb0b8c9489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:58.205937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff56d3-bdff-4079-813a-b0bb0b8c9489 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.206227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff56d3-bdff-4079-813a-b0bb0b8c9489 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.206511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff56d3-bdff-4079-813a-b0bb0b8c9489 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.207288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff56d3-bdff-4079-813a-b0bb0b8c9489 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:58.207603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff56d3-bdff-4079-813a-b0bb0b8c9489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:58.209095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff56d3-bdff-4079-813a-b0bb0b8c9489 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:58.219067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 138/277] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:58.225333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209f610-0599-4f82-9dee-114387251dc3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:58.289339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:58.355271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209f610-0599-4f82-9dee-114387251dc3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:58.393117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6ed49-92c0-4e77-8507-6605dbd4b443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:58.394015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6ed49-92c0-4e77-8507-6605dbd4b443 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.394304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6ed49-92c0-4e77-8507-6605dbd4b443 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.394583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6ed49-92c0-4e77-8507-6605dbd4b443 None admin] PATH_INFO: `/v3/users/8267995c040f43ebbd1419df8e57c397` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.413562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6ed49-92c0-4e77-8507-6605dbd4b443 None admin] RBAC: Authorizing `identity:get_user(user_id=8267995c040f43ebbd1419df8e57c397)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:58.415085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6ed49-92c0-4e77-8507-6605dbd4b443 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:58.417283 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 140/278] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:58 2022] GET /identity/v3/users/8267995c040f43ebbd1419df8e57c397 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:58.423076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff56d3-bdff-4079-813a-b0bb0b8c9489 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:58.544557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff56d3-bdff-4079-813a-b0bb0b8c9489 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:58.574835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:58.585904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05799a4-6d18-43e5-89b2-1ca481e9faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:58.586582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05799a4-6d18-43e5-89b2-1ca481e9faee None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.586873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05799a4-6d18-43e5-89b2-1ca481e9faee None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.587153 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05799a4-6d18-43e5-89b2-1ca481e9faee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.588005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05799a4-6d18-43e5-89b2-1ca481e9faee None admin] RBAC: Adding query filter params (role.id=f5a5bdf6fee0438391dd54c5b545305e, user.id=8267995c040f43ebbd1419df8e57c397, scope.system=all) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:58.588327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05799a4-6d18-43e5-89b2-1ca481e9faee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:58.589854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05799a4-6d18-43e5-89b2-1ca481e9faee None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:58.595635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 139/279] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jun 20 05:59:58 2022] GET /identity/v3/role_assignments?user.id=8267995c040f43ebbd1419df8e57c397&scope.system=all&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:58.637443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db3c95-a04a-4161-ad1a-c8bf0caed6a4 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.637749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db3c95-a04a-4161-ad1a-c8bf0caed6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.638013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db3c95-a04a-4161-ad1a-c8bf0caed6a4 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.639676 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 141/280] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:58.645525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331533c-793d-48a2-883e-b4cfdd528e82 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.645813 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331533c-793d-48a2-883e-b4cfdd528e82 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.646100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331533c-793d-48a2-883e-b4cfdd528e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.673766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9331533c-793d-48a2-883e-b4cfdd528e82 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:58.674984 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9331533c-793d-48a2-883e-b4cfdd528e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:58.774547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 140/281] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:59:58.810018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db3c95-a04a-4161-ad1a-c8bf0caed6a4 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:58.926828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:58.936948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db3c95-a04a-4161-ad1a-c8bf0caed6a4 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:58.981479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2c94-a74b-4fb2-af4e-69283d51c9d7 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.981982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2c94-a74b-4fb2-af4e-69283d51c9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.982056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2c94-a74b-4fb2-af4e-69283d51c9d7 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.983659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 141/282] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 05:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:58.983873 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2193c-f85a-4757-b890-28813ccf360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:58.984705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2193c-f85a-4757-b890-28813ccf360a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.984996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2193c-f85a-4757-b890-28813ccf360a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.985273 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2193c-f85a-4757-b890-28813ccf360a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.988876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b5a18-62a0-4e5e-a5a4-1dfc7b63b29a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.989173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b5a18-62a0-4e5e-a5a4-1dfc7b63b29a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.989460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b5a18-62a0-4e5e-a5a4-1dfc7b63b29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:59.003503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2193c-f85a-4757-b890-28813ccf360a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-eac2193c-f85a-4757-b890-28813ccf360a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:59.018207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:59.019159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:59:59.019956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 05:59:59.020561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a82b5a18-62a0-4e5e-a5a4-1dfc7b63b29a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:59.021957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a82b5a18-62a0-4e5e-a5a4-1dfc7b63b29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:59.029995 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 142/283] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:59:59.030936 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2193c-f85a-4757-b890-28813ccf360a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:59.151232 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 142/284] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:59:59.178067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b5a18-62a0-4e5e-a5a4-1dfc7b63b29a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:59.212723 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2193c-f85a-4757-b890-28813ccf360a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:59.265807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830916f1-fc68-48bc-8f12-a9065dec888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:59.266499 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830916f1-fc68-48bc-8f12-a9065dec888e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:59.266789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830916f1-fc68-48bc-8f12-a9065dec888e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:59.267071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830916f1-fc68-48bc-8f12-a9065dec888e None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:59.267836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830916f1-fc68-48bc-8f12-a9065dec888e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:59.268152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830916f1-fc68-48bc-8f12-a9065dec888e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:59.269604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830916f1-fc68-48bc-8f12-a9065dec888e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:59.281246 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:59.283767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 143/285] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:59.297617 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830916f1-fc68-48bc-8f12-a9065dec888e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:59.320542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:59.367120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b5a18-62a0-4e5e-a5a4-1dfc7b63b29a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:59.431312 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea90909-fb53-4598-ad05-5f184c57042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:59.432040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea90909-fb53-4598-ad05-5f184c57042b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:59.432328 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea90909-fb53-4598-ad05-5f184c57042b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:59.432648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea90909-fb53-4598-ad05-5f184c57042b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:59.442600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830916f1-fc68-48bc-8f12-a9065dec888e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:59.457532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea90909-fb53-4598-ad05-5f184c57042b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4ea90909-fb53-4598-ad05-5f184c57042b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:59:59.465722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:59:59.466624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:59:59.467450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 05:59:59.473914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 143/286] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 05:59:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:59:59.477564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048540fd-53ba-4e65-8973-6beb1b3bfe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:59.478453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048540fd-53ba-4e65-8973-6beb1b3bfe54 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:59.478903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048540fd-53ba-4e65-8973-6beb1b3bfe54 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:59.479189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048540fd-53ba-4e65-8973-6beb1b3bfe54 None admin] PATH_INFO: `/v3/users/8198a33cf9614bbe90d032ef7a9d850f` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:59.479761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea90909-fb53-4598-ad05-5f184c57042b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:59.480782 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048540fd-53ba-4e65-8973-6beb1b3bfe54 None admin] RBAC: Authorizing `identity:get_user(user_id=8198a33cf9614bbe90d032ef7a9d850f)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:59.482407 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048540fd-53ba-4e65-8973-6beb1b3bfe54 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:59.484566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 144/287] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:59 2022] GET /identity/v3/users/8198a33cf9614bbe90d032ef7a9d850f => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:59.491914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048540fd-53ba-4e65-8973-6beb1b3bfe54 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:59.601008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:59.617201 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048540fd-53ba-4e65-8973-6beb1b3bfe54 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:59.666892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c49e8a-e9e1-4fc8-a27b-cb509733c4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:59.668096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c49e8a-e9e1-4fc8-a27b-cb509733c4fd None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:59.668570 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c49e8a-e9e1-4fc8-a27b-cb509733c4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:59.669519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c49e8a-e9e1-4fc8-a27b-cb509733c4fd None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:59.670907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c49e8a-e9e1-4fc8-a27b-cb509733c4fd None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:59.672529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c49e8a-e9e1-4fc8-a27b-cb509733c4fd None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:59.674870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 145/288] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 05:59:59 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:59:59.681621 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c49e8a-e9e1-4fc8-a27b-cb509733c4fd None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:59.795296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c49e8a-e9e1-4fc8-a27b-cb509733c4fd None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:59.834966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f073279-88dd-4fc1-bc5c-f0da408746c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:59.836131 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073279-88dd-4fc1-bc5c-f0da408746c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:59.836573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073279-88dd-4fc1-bc5c-f0da408746c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:59.837043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073279-88dd-4fc1-bc5c-f0da408746c3 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/users/8198a33cf9614bbe90d032ef7a9d850f/roles/bee6c92a21d64b28b852f8719be02e65` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:59.839435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f073279-88dd-4fc1-bc5c-f0da408746c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a, user_id=8198a33cf9614bbe90d032ef7a9d850f, role_id=bee6c92a21d64b28b852f8719be02e65)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:59.841218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f073279-88dd-4fc1-bc5c-f0da408746c3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:59.843071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea90909-fb53-4598-ad05-5f184c57042b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:59.863321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 146/289] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 05:59:59 2022] PUT /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/users/8198a33cf9614bbe90d032ef7a9d850f/roles/bee6c92a21d64b28b852f8719be02e65 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:59:59.878872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:59.926603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de44b01-fdbc-4a9c-8f52-3a5f41236d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:59.927318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de44b01-fdbc-4a9c-8f52-3a5f41236d9c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:59.927699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de44b01-fdbc-4a9c-8f52-3a5f41236d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:59.928023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de44b01-fdbc-4a9c-8f52-3a5f41236d9c None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:59.928845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de44b01-fdbc-4a9c-8f52-3a5f41236d9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:59:59.929164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de44b01-fdbc-4a9c-8f52-3a5f41236d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:59.930616 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de44b01-fdbc-4a9c-8f52-3a5f41236d9c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:59.947387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 144/290] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 05:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:59:59.952992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f073279-88dd-4fc1-bc5c-f0da408746c3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:59.984813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:00.089642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f073279-88dd-4fc1-bc5c-f0da408746c3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:00.127428 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d47e17-05c4-46a9-9789-cf7f4e815045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:00.128556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47e17-05c4-46a9-9789-cf7f4e815045 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:00.129023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47e17-05c4-46a9-9789-cf7f4e815045 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:00.129478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47e17-05c4-46a9-9789-cf7f4e815045 None admin] PATH_INFO: `/v3/users/ed27c604eb624e988e2853c0caba3a8a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:00.130935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d47e17-05c4-46a9-9789-cf7f4e815045 None admin] RBAC: Authorizing `identity:get_user(user_id=ed27c604eb624e988e2853c0caba3a8a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:00.132752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d47e17-05c4-46a9-9789-cf7f4e815045 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:00.134546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 147/291] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 05:59:59 2022] GET /identity/v3/users/ed27c604eb624e988e2853c0caba3a8a => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:00.140178 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de44b01-fdbc-4a9c-8f52-3a5f41236d9c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:00.269236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de44b01-fdbc-4a9c-8f52-3a5f41236d9c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:00.307210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887e6a2-97d8-40ef-a00c-c1eb9828d647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:00.307869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887e6a2-97d8-40ef-a00c-c1eb9828d647 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:00.308156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887e6a2-97d8-40ef-a00c-c1eb9828d647 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:00.308440 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887e6a2-97d8-40ef-a00c-c1eb9828d647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:00.375429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:00.402716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887e6a2-97d8-40ef-a00c-c1eb9828d647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:00.404406 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887e6a2-97d8-40ef-a00c-c1eb9828d647 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:00.514616 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 145/292] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:00.520199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d47e17-05c4-46a9-9789-cf7f4e815045 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:00.549618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c6a1a-1c89-4a2f-bad5-89b191d3836a None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:00.549618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c6a1a-1c89-4a2f-bad5-89b191d3836a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:00.549900 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c6a1a-1c89-4a2f-bad5-89b191d3836a None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:00.551347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 146/293] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:00.556641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4c15a-c905-402d-80b6-098fd48c873d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:00.556948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4c15a-c905-402d-80b6-098fd48c873d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:00.557229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4c15a-c905-402d-80b6-098fd48c873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:00.576796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-85e4c15a-c905-402d-80b6-098fd48c873d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:00.577997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-85e4c15a-c905-402d-80b6-098fd48c873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:00.685019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:00.710138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d47e17-05c4-46a9-9789-cf7f4e815045 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:00.710518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 147/294] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:00.734279 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4c15a-c905-402d-80b6-098fd48c873d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:00.745001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:00.774810 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88f4a2-b57e-4c39-89c3-74028aeb12ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:00.775602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f4a2-b57e-4c39-89c3-74028aeb12ce None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:00.775947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f4a2-b57e-4c39-89c3-74028aeb12ce None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:00.776219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f4a2-b57e-4c39-89c3-74028aeb12ce None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:00.781207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88f4a2-b57e-4c39-89c3-74028aeb12ce None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:00.782716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88f4a2-b57e-4c39-89c3-74028aeb12ce None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:00.785039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 148/295] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:00 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:00.792098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88f4a2-b57e-4c39-89c3-74028aeb12ce None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:00.842263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4c15a-c905-402d-80b6-098fd48c873d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:00.877262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116be39-7716-4889-a6d7-81f62d18cccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:00.878078 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116be39-7716-4889-a6d7-81f62d18cccd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:00.878364 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116be39-7716-4889-a6d7-81f62d18cccd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:00.878646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116be39-7716-4889-a6d7-81f62d18cccd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:00.889905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116be39-7716-4889-a6d7-81f62d18cccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-1116be39-7716-4889-a6d7-81f62d18cccd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:00.899004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:00.899937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:00.901595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 148/296] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:00.906144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116be39-7716-4889-a6d7-81f62d18cccd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:00.981065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88f4a2-b57e-4c39-89c3-74028aeb12ce None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:00.997734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:01.016088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116be39-7716-4889-a6d7-81f62d18cccd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:01.019444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddfee2-cf04-43f5-b570-7ea5c4c8c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.020110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddfee2-cf04-43f5-b570-7ea5c4c8c81a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.020396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddfee2-cf04-43f5-b570-7ea5c4c8c81a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.020704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddfee2-cf04-43f5-b570-7ea5c4c8c81a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.022126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddfee2-cf04-43f5-b570-7ea5c4c8c81a None admin] RBAC: Adding query filter params (role.id=f5a5bdf6fee0438391dd54c5b545305e, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a, user.id=ed27c604eb624e988e2853c0caba3a8a) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:01.022539 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddfee2-cf04-43f5-b570-7ea5c4c8c81a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:01.025084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddfee2-cf04-43f5-b570-7ea5c4c8c81a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:01.031713 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 149/297] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:00 2022] GET /identity/v3/role_assignments?user.id=ed27c604eb624e988e2853c0caba3a8a&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:01.032987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e5571-40a6-47b8-b238-5af64cd42ef6 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.033334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e5571-40a6-47b8-b238-5af64cd42ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.033621 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e5571-40a6-47b8-b238-5af64cd42ef6 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.035266 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 150/298] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:01.041024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2a0c-e56e-426a-abba-56d49bec39b0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.041316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2a0c-e56e-426a-abba-56d49bec39b0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.041601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2a0c-e56e-426a-abba-56d49bec39b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.060551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-02ae2a0c-e56e-426a-abba-56d49bec39b0 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:01.061961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-02ae2a0c-e56e-426a-abba-56d49bec39b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:01.070874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24155aff-2ba7-44e0-8a61-22147469b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.071615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24155aff-2ba7-44e0-8a61-22147469b732 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.071964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24155aff-2ba7-44e0-8a61-22147469b732 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.072253 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24155aff-2ba7-44e0-8a61-22147469b732 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.073200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24155aff-2ba7-44e0-8a61-22147469b732 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:01.073520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24155aff-2ba7-44e0-8a61-22147469b732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:01.074591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:01.075815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24155aff-2ba7-44e0-8a61-22147469b732 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:01.092870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 149/299] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:01.098536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24155aff-2ba7-44e0-8a61-22147469b732 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:01.153092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 151/300] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:01.164103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac83c82-302a-478a-b1d9-bd6ba9b8128b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.164418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac83c82-302a-478a-b1d9-bd6ba9b8128b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.164677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac83c82-302a-478a-b1d9-bd6ba9b8128b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.166369 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 152/301] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:01.174874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cac043-aac7-4116-8f4f-daa80d65eb41 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.175280 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cac043-aac7-4116-8f4f-daa80d65eb41 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.175627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cac043-aac7-4116-8f4f-daa80d65eb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.201826 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c0cac043-aac7-4116-8f4f-daa80d65eb41 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:01.203051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c0cac043-aac7-4116-8f4f-daa80d65eb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:01.266535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24155aff-2ba7-44e0-8a61-22147469b732 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:01.277420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 153/302] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:01.278209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cac043-aac7-4116-8f4f-daa80d65eb41 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:01.302908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:01.315558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa248c-e387-45a6-9f79-5fe875cf00d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.316471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa248c-e387-45a6-9f79-5fe875cf00d9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.316786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa248c-e387-45a6-9f79-5fe875cf00d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.317069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa248c-e387-45a6-9f79-5fe875cf00d9 None admin] PATH_INFO: `/v3/users/e914b868c44045babd511da269a8fead` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.333080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa248c-e387-45a6-9f79-5fe875cf00d9 None admin] RBAC: Authorizing `identity:get_user(user_id=e914b868c44045babd511da269a8fead)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:01.336000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa248c-e387-45a6-9f79-5fe875cf00d9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:01.338393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 150/303] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:01 2022] GET /identity/v3/users/e914b868c44045babd511da269a8fead => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:01.339295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa248c-e387-45a6-9f79-5fe875cf00d9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:01.371598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:01.406050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cac043-aac7-4116-8f4f-daa80d65eb41 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:01.444315 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc44f8b-3df4-44b6-843a-18ad7ee37a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.445292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc44f8b-3df4-44b6-843a-18ad7ee37a41 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.445579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc44f8b-3df4-44b6-843a-18ad7ee37a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.445848 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc44f8b-3df4-44b6-843a-18ad7ee37a41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.447052 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc44f8b-3df4-44b6-843a-18ad7ee37a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:01.448522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc44f8b-3df4-44b6-843a-18ad7ee37a41 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:01.452764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 154/304] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:01.454473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc44f8b-3df4-44b6-843a-18ad7ee37a41 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:01.456000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa248c-e387-45a6-9f79-5fe875cf00d9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:01.492732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477073d1-6299-4f91-bc60-99cd6fc97d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.493630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477073d1-6299-4f91-bc60-99cd6fc97d88 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.493994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477073d1-6299-4f91-bc60-99cd6fc97d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.494274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477073d1-6299-4f91-bc60-99cd6fc97d88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.506627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477073d1-6299-4f91-bc60-99cd6fc97d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-477073d1-6299-4f91-bc60-99cd6fc97d88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:01.514821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:01.515802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:01.516711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 151/305] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:01.517392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477073d1-6299-4f91-bc60-99cd6fc97d88 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:01.569977 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:01.572000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc44f8b-3df4-44b6-843a-18ad7ee37a41 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:01.607983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560bbd7-71e8-47ae-8a5c-885a8adf5ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.608664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560bbd7-71e8-47ae-8a5c-885a8adf5ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.608953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560bbd7-71e8-47ae-8a5c-885a8adf5ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.609232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560bbd7-71e8-47ae-8a5c-885a8adf5ca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.610067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560bbd7-71e8-47ae-8a5c-885a8adf5ca1 None admin] RBAC: Adding query filter params (role.id=bee6c92a21d64b28b852f8719be02e65, user.id=e914b868c44045babd511da269a8fead, scope.system=all) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:01.610382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560bbd7-71e8-47ae-8a5c-885a8adf5ca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:01.611940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560bbd7-71e8-47ae-8a5c-885a8adf5ca1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:01.618057 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 155/306] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jun 20 06:00:01 2022] GET /identity/v3/role_assignments?user.id=e914b868c44045babd511da269a8fead&scope.system=all&role.id=bee6c92a21d64b28b852f8719be02e65 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:01.618699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560bbd7-71e8-47ae-8a5c-885a8adf5ca1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:01.636875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:01.643320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477073d1-6299-4f91-bc60-99cd6fc97d88 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:01.684338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ac141-c905-4df9-ba5a-3d53f47de4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.685066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ac141-c905-4df9-ba5a-3d53f47de4bb None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.685397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ac141-c905-4df9-ba5a-3d53f47de4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.685681 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ac141-c905-4df9-ba5a-3d53f47de4bb None admin] PATH_INFO: `/v3/groups` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.686402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ac141-c905-4df9-ba5a-3d53f47de4bb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:01.687883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ac141-c905-4df9-ba5a-3d53f47de4bb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:01.708799 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 152/307] 10.222.0.40 () {60 vars in 1134 bytes} [Mon Jun 20 06:00:01 2022] POST /identity/v3/groups => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:00:01.771043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560bbd7-71e8-47ae-8a5c-885a8adf5ca1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:01.813199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a99581-bfab-4044-95be-9cf0ebc67f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.813947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a99581-bfab-4044-95be-9cf0ebc67f44 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.814243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a99581-bfab-4044-95be-9cf0ebc67f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.814525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a99581-bfab-4044-95be-9cf0ebc67f44 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.815304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a99581-bfab-4044-95be-9cf0ebc67f44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:01.815618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a99581-bfab-4044-95be-9cf0ebc67f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:01.817102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a99581-bfab-4044-95be-9cf0ebc67f44 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:01.827225 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 156/308] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:01.832797 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ac141-c905-4df9-ba5a-3d53f47de4bb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:01.943033 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ac141-c905-4df9-ba5a-3d53f47de4bb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:01.951001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:01.982197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630c88-69f6-48a3-bf2f-a7ab05cfb799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:01.983080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630c88-69f6-48a3-bf2f-a7ab05cfb799 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:01.983368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630c88-69f6-48a3-bf2f-a7ab05cfb799 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:01.983647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630c88-69f6-48a3-bf2f-a7ab05cfb799 None admin] PATH_INFO: `/v3/users/8267995c040f43ebbd1419df8e57c397` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:01.984908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af630c88-69f6-48a3-bf2f-a7ab05cfb799 None admin] RBAC: Authorizing `identity:get_user(user_id=8267995c040f43ebbd1419df8e57c397)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:01.986380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af630c88-69f6-48a3-bf2f-a7ab05cfb799 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:01.988324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 153/309] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:01 2022] GET /identity/v3/users/8267995c040f43ebbd1419df8e57c397 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:01.994483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a99581-bfab-4044-95be-9cf0ebc67f44 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:02.068983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:02.104888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a99581-bfab-4044-95be-9cf0ebc67f44 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:02.141426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724b70-df41-4609-ba9f-5279c8a72f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:02.142365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724b70-df41-4609-ba9f-5279c8a72f1f None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.142656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724b70-df41-4609-ba9f-5279c8a72f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.142991 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724b70-df41-4609-ba9f-5279c8a72f1f None admin] PATH_INFO: `/v3/system/users/8267995c040f43ebbd1419df8e57c397/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.144576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9724b70-df41-4609-ba9f-5279c8a72f1f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8267995c040f43ebbd1419df8e57c397, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:02.146027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9724b70-df41-4609-ba9f-5279c8a72f1f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:02.156168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 157/310] 10.222.0.40 () {58 vars in 1334 bytes} [Mon Jun 20 06:00:01 2022] PUT /identity/v3/system/users/8267995c040f43ebbd1419df8e57c397/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:02.468575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdf37b-810d-47c8-ace3-1c63f0871266 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.469086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdf37b-810d-47c8-ace3-1c63f0871266 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.469086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdf37b-810d-47c8-ace3-1c63f0871266 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.470600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 154/311] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:02.476144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5e039-39dc-481d-a0d3-b592e52eb525 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.476729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5e039-39dc-481d-a0d3-b592e52eb525 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.477230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5e039-39dc-481d-a0d3-b592e52eb525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.495371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e2d5e039-39dc-481d-a0d3-b592e52eb525 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:02.496917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e2d5e039-39dc-481d-a0d3-b592e52eb525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:02.567247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 158/312] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:02.591917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdf37b-810d-47c8-ace3-1c63f0871266 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:02.705773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdf37b-810d-47c8-ace3-1c63f0871266 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:02.741887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9a59f-57e5-4905-bb50-4d473eabfa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:02.742612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a59f-57e5-4905-bb50-4d473eabfa31 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.742947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a59f-57e5-4905-bb50-4d473eabfa31 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.743232 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a59f-57e5-4905-bb50-4d473eabfa31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.755397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9a59f-57e5-4905-bb50-4d473eabfa31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-c9b9a59f-57e5-4905-bb50-4d473eabfa31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:02.764480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:02.765473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:02.766708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 155/313] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:02.772121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5e039-39dc-481d-a0d3-b592e52eb525 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:02.837768 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:02.882882 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5e039-39dc-481d-a0d3-b592e52eb525 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:02.919281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9dcc0-31a8-466a-8fe9-f2455e051b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:02.919964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9dcc0-31a8-466a-8fe9-f2455e051b30 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.920252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9dcc0-31a8-466a-8fe9-f2455e051b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.920532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9dcc0-31a8-466a-8fe9-f2455e051b30 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.921408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9dcc0-31a8-466a-8fe9-f2455e051b30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:02.921724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9dcc0-31a8-466a-8fe9-f2455e051b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:02.923129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9dcc0-31a8-466a-8fe9-f2455e051b30 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:02.932934 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 159/314] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:02.938392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9a59f-57e5-4905-bb50-4d473eabfa31 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:02.978579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:03.050550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9a59f-57e5-4905-bb50-4d473eabfa31 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:03.087120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c7a0e-32ca-4bf6-9d31-fc6f8d1157e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:03.088314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c7a0e-32ca-4bf6-9d31-fc6f8d1157e0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:03.088822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c7a0e-32ca-4bf6-9d31-fc6f8d1157e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:03.089293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c7a0e-32ca-4bf6-9d31-fc6f8d1157e0 None admin] PATH_INFO: `/v3/users/8198a33cf9614bbe90d032ef7a9d850f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:03.090676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c7a0e-32ca-4bf6-9d31-fc6f8d1157e0 None admin] RBAC: Authorizing `identity:get_user(user_id=8198a33cf9614bbe90d032ef7a9d850f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:03.092325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c7a0e-32ca-4bf6-9d31-fc6f8d1157e0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:03.094517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 156/315] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:02 2022] GET /identity/v3/users/8198a33cf9614bbe90d032ef7a9d850f => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:03.100722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9dcc0-31a8-466a-8fe9-f2455e051b30 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:03.207652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9dcc0-31a8-466a-8fe9-f2455e051b30 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:03.235231 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:03.247472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a5088-529a-4bc1-80d3-b9ddedfddbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:03.248422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a5088-529a-4bc1-80d3-b9ddedfddbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:03.248926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a5088-529a-4bc1-80d3-b9ddedfddbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:03.249411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a5088-529a-4bc1-80d3-b9ddedfddbe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:03.326318 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a5088-529a-4bc1-80d3-b9ddedfddbe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:03.327732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a5088-529a-4bc1-80d3-b9ddedfddbe6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:03.433900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 160/316] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:03.439447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c7a0e-32ca-4bf6-9d31-fc6f8d1157e0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:03.548571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c7a0e-32ca-4bf6-9d31-fc6f8d1157e0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:03.550830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:03.587428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25e298-5871-4d47-923e-9b19255cfa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:03.588658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e298-5871-4d47-923e-9b19255cfa82 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:03.589195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e298-5871-4d47-923e-9b19255cfa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:03.589663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e298-5871-4d47-923e-9b19255cfa82 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:03.591151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25e298-5871-4d47-923e-9b19255cfa82 None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:03.592822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25e298-5871-4d47-923e-9b19255cfa82 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:03.595076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 157/317] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:03 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:03.602195 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a5088-529a-4bc1-80d3-b9ddedfddbe6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:03.634241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:03.714820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a5088-529a-4bc1-80d3-b9ddedfddbe6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:03.725870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f984f53-8171-46e6-a14b-9ef27e8eeb6e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:03.726595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f984f53-8171-46e6-a14b-9ef27e8eeb6e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:03.727112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f984f53-8171-46e6-a14b-9ef27e8eeb6e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:03.732599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 158/318] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:03.734376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888b886-8033-4612-ac2d-861fc6cfcbfe None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:03.734885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888b886-8033-4612-ac2d-861fc6cfcbfe None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:03.735714 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888b886-8033-4612-ac2d-861fc6cfcbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:03.753352 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a08362-867f-4250-932c-fb3367f57eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:03.754016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a08362-867f-4250-932c-fb3367f57eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:03.754298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a08362-867f-4250-932c-fb3367f57eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:03.754573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a08362-867f-4250-932c-fb3367f57eb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:03.755473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a08362-867f-4250-932c-fb3367f57eb7 None admin] RBAC: Adding query filter params (role.id=bee6c92a21d64b28b852f8719be02e65, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a, user.id=8198a33cf9614bbe90d032ef7a9d850f) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:03.755820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a08362-867f-4250-932c-fb3367f57eb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:03.756501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a888b886-8033-4612-ac2d-861fc6cfcbfe None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:03.757967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a888b886-8033-4612-ac2d-861fc6cfcbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:03.758927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a08362-867f-4250-932c-fb3367f57eb7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:03.766247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 161/319] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:03 2022] GET /identity/v3/role_assignments?user.id=8198a33cf9614bbe90d032ef7a9d850f&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=bee6c92a21d64b28b852f8719be02e65 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:03.842534 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 159/320] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:03.867276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a08362-867f-4250-932c-fb3367f57eb7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:03.914343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadd740-47cf-4fe9-aaa5-dfc0d75c6599 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:03.914677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadd740-47cf-4fe9-aaa5-dfc0d75c6599 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:03.915535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadd740-47cf-4fe9-aaa5-dfc0d75c6599 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:03.917693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 160/321] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:03.922702 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033998a6-f9e3-4392-956a-bddb0fbd6ede None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:03.923001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033998a6-f9e3-4392-956a-bddb0fbd6ede None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:03.923287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033998a6-f9e3-4392-956a-bddb0fbd6ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:03.943778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-033998a6-f9e3-4392-956a-bddb0fbd6ede None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:03.945020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-033998a6-f9e3-4392-956a-bddb0fbd6ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:03.979413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:03.992647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a08362-867f-4250-932c-fb3367f57eb7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:04.034874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 161/322] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:04.039653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ef96a-5aef-4ae9-8727-fff2484a5779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:04.040766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ef96a-5aef-4ae9-8727-fff2484a5779 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.041259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ef96a-5aef-4ae9-8727-fff2484a5779 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.041760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ef96a-5aef-4ae9-8727-fff2484a5779 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.052964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ef96a-5aef-4ae9-8727-fff2484a5779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:04.058606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033998a6-f9e3-4392-956a-bddb0fbd6ede None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-882ef96a-5aef-4ae9-8727-fff2484a5779 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:04.062897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:04.063812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 06:00:04.064660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:04.070822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 162/323] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:04.072206 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ef96a-5aef-4ae9-8727-fff2484a5779 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:04.094801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:04.168496 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033998a6-f9e3-4392-956a-bddb0fbd6ede None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:04.185231 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ef96a-5aef-4ae9-8727-fff2484a5779 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:04.205092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b4153-9c86-4141-9799-8b89190d7649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:04.205895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4153-9c86-4141-9799-8b89190d7649 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.206186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4153-9c86-4141-9799-8b89190d7649 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.206466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b4153-9c86-4141-9799-8b89190d7649 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.207657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b4153-9c86-4141-9799-8b89190d7649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:04.209219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b4153-9c86-4141-9799-8b89190d7649 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:04.215560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 162/324] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:04.216200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b4153-9c86-4141-9799-8b89190d7649 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:04.222120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19f738-8a68-4854-8b28-b8769376719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:04.223317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19f738-8a68-4854-8b28-b8769376719d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.223754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19f738-8a68-4854-8b28-b8769376719d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.224179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19f738-8a68-4854-8b28-b8769376719d None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.225783 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19f738-8a68-4854-8b28-b8769376719d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:04.226244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19f738-8a68-4854-8b28-b8769376719d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:04.227804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19f738-8a68-4854-8b28-b8769376719d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:04.241759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 163/325] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:04.243022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19f738-8a68-4854-8b28-b8769376719d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:04.260485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:04.317225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:04.322860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b4153-9c86-4141-9799-8b89190d7649 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:04.358246 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e68e10-415d-45a9-8f48-b54992d67f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:04.358838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68e10-415d-45a9-8f48-b54992d67f2a None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.358983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19f738-8a68-4854-8b28-b8769376719d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:04.359127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68e10-415d-45a9-8f48-b54992d67f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.359403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68e10-415d-45a9-8f48-b54992d67f2a None admin] PATH_INFO: `/v3/groups` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.360092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e68e10-415d-45a9-8f48-b54992d67f2a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:04.361575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e68e10-415d-45a9-8f48-b54992d67f2a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:04.374307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 163/326] 10.222.0.40 () {60 vars in 1134 bytes} [Mon Jun 20 06:00:04 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:00:04.378121 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439376b6-48b6-417d-91f9-bb0b5924806d None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.378475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439376b6-48b6-417d-91f9-bb0b5924806d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.378763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439376b6-48b6-417d-91f9-bb0b5924806d None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.380362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 164/327] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:04.386672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807750c9-6f7c-4214-ac71-e409c8cd070c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.386973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807750c9-6f7c-4214-ac71-e409c8cd070c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.387259 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807750c9-6f7c-4214-ac71-e409c8cd070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.397453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7137e1c-8cdb-46f2-b3fb-6fcd762c6eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:04.398355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7137e1c-8cdb-46f2-b3fb-6fcd762c6eeb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.398640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7137e1c-8cdb-46f2-b3fb-6fcd762c6eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.398927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7137e1c-8cdb-46f2-b3fb-6fcd762c6eeb None admin] PATH_INFO: `/v3/users/e914b868c44045babd511da269a8fead` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.400225 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7137e1c-8cdb-46f2-b3fb-6fcd762c6eeb None admin] RBAC: Authorizing `identity:get_user(user_id=e914b868c44045babd511da269a8fead)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:04.401791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7137e1c-8cdb-46f2-b3fb-6fcd762c6eeb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:04.403547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 164/328] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:04 2022] GET /identity/v3/users/e914b868c44045babd511da269a8fead => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:04.409795 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7137e1c-8cdb-46f2-b3fb-6fcd762c6eeb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:04.409973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-807750c9-6f7c-4214-ac71-e409c8cd070c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:04.411143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-807750c9-6f7c-4214-ac71-e409c8cd070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:04.485399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 165/329] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:04.502102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:04.509249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807750c9-6f7c-4214-ac71-e409c8cd070c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:04.525617 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7137e1c-8cdb-46f2-b3fb-6fcd762c6eeb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:04.565183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc29fcf-6564-4004-9e05-a1f5c10f2233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:04.566530 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc29fcf-6564-4004-9e05-a1f5c10f2233 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.567081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc29fcf-6564-4004-9e05-a1f5c10f2233 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.567522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc29fcf-6564-4004-9e05-a1f5c10f2233 None admin] PATH_INFO: `/v3/system/users/e914b868c44045babd511da269a8fead/roles/bee6c92a21d64b28b852f8719be02e65` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.570220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc29fcf-6564-4004-9e05-a1f5c10f2233 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e914b868c44045babd511da269a8fead, role_id=bee6c92a21d64b28b852f8719be02e65)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:04.571635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc29fcf-6564-4004-9e05-a1f5c10f2233 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:04.579560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 165/330] 10.222.0.40 () {58 vars in 1334 bytes} [Mon Jun 20 06:00:04 2022] PUT /identity/v3/system/users/e914b868c44045babd511da269a8fead/roles/bee6c92a21d64b28b852f8719be02e65 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:04.613649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:04.633600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807750c9-6f7c-4214-ac71-e409c8cd070c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:04.677281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f614c36-2de4-46c6-94c8-c83f7e5ed6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:04.678171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f614c36-2de4-46c6-94c8-c83f7e5ed6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.678464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f614c36-2de4-46c6-94c8-c83f7e5ed6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.678748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f614c36-2de4-46c6-94c8-c83f7e5ed6a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.691314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f614c36-2de4-46c6-94c8-c83f7e5ed6a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-5f614c36-2de4-46c6-94c8-c83f7e5ed6a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:04.699735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:04.700732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:04.701536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 166/331] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:04.707016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc29fcf-6564-4004-9e05-a1f5c10f2233 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:04.824274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc29fcf-6564-4004-9e05-a1f5c10f2233 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:04.860860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0964be-ec7d-4b5a-ad17-d412bc9f014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:04.861904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0964be-ec7d-4b5a-ad17-d412bc9f014e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.862395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0964be-ec7d-4b5a-ad17-d412bc9f014e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.862868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0964be-ec7d-4b5a-ad17-d412bc9f014e None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.863637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0964be-ec7d-4b5a-ad17-d412bc9f014e None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:04.864001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0964be-ec7d-4b5a-ad17-d412bc9f014e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:04.865436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0964be-ec7d-4b5a-ad17-d412bc9f014e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:04.874612 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 166/332] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:04.880005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f614c36-2de4-46c6-94c8-c83f7e5ed6a2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:05.016570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f614c36-2de4-46c6-94c8-c83f7e5ed6a2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:05.059096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905a32b-614d-4181-8be2-d1ea7fbc1145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:05.060258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a32b-614d-4181-8be2-d1ea7fbc1145 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:05.060721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a32b-614d-4181-8be2-d1ea7fbc1145 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:05.061145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a32b-614d-4181-8be2-d1ea7fbc1145 None admin] PATH_INFO: `/v3/users/8267995c040f43ebbd1419df8e57c397` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:05.062651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905a32b-614d-4181-8be2-d1ea7fbc1145 None admin] RBAC: Authorizing `identity:get_user(user_id=8267995c040f43ebbd1419df8e57c397)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:05.064265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905a32b-614d-4181-8be2-d1ea7fbc1145 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:05.066411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 167/333] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:04 2022] GET /identity/v3/users/8267995c040f43ebbd1419df8e57c397 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:05.072002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0964be-ec7d-4b5a-ad17-d412bc9f014e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:05.086385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:05.189011 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0964be-ec7d-4b5a-ad17-d412bc9f014e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:05.225241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212cac9-6631-4790-b772-33e5d46cdab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:05.226618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cac9-6631-4790-b772-33e5d46cdab5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:05.227104 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cac9-6631-4790-b772-33e5d46cdab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:05.227556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cac9-6631-4790-b772-33e5d46cdab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:05.228572 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212cac9-6631-4790-b772-33e5d46cdab5 None admin] RBAC: Adding query filter params (role.id=f5a5bdf6fee0438391dd54c5b545305e, user.id=8267995c040f43ebbd1419df8e57c397, scope.system=all) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:05.229093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212cac9-6631-4790-b772-33e5d46cdab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:05.230746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212cac9-6631-4790-b772-33e5d46cdab5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:05.245241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 167/334] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jun 20 06:00:05 2022] GET /identity/v3/role_assignments?user.id=8267995c040f43ebbd1419df8e57c397&scope.system=all&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:06.900728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b9925-7fc7-4146-9a51-fb922e3e4ecd None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:06.901721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b9925-7fc7-4146-9a51-fb922e3e4ecd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:06.902251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b9925-7fc7-4146-9a51-fb922e3e4ecd None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:06.903927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 168/335] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:06.909665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f4e7a-23bd-4cf8-95d2-6b97afd39ddd None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:06.910515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f4e7a-23bd-4cf8-95d2-6b97afd39ddd None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:06.911002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f4e7a-23bd-4cf8-95d2-6b97afd39ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:06.933945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1d2f4e7a-23bd-4cf8-95d2-6b97afd39ddd None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:06.935520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1d2f4e7a-23bd-4cf8-95d2-6b97afd39ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:07.016641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:07.025504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 168/336] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:07.063731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b9925-7fc7-4146-9a51-fb922e3e4ecd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:07.083483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:07.111895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5a565-8109-4e50-983e-b79c8cee7001 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.112558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5a565-8109-4e50-983e-b79c8cee7001 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.113096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5a565-8109-4e50-983e-b79c8cee7001 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.114681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 169/337] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:07.131337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931708fd-5850-468f-9006-7fb00564914d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.131952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931708fd-5850-468f-9006-7fb00564914d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.132459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931708fd-5850-468f-9006-7fb00564914d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.161573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-931708fd-5850-468f-9006-7fb00564914d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:07.163150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-931708fd-5850-468f-9006-7fb00564914d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:07.249142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b9925-7fc7-4146-9a51-fb922e3e4ecd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:07.281436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 170/338] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:07.285350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d039a-5797-436d-a73d-e95b51405d2a None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.285350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d039a-5797-436d-a73d-e95b51405d2a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.285350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d039a-5797-436d-a73d-e95b51405d2a None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.285350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 171/339] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:07.292415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39439298-cd8a-46d7-86c8-05f689739ecc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.292994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39439298-cd8a-46d7-86c8-05f689739ecc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.293561 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39439298-cd8a-46d7-86c8-05f689739ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.294060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3a7e-a465-42f8-b774-0503aa6ee762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:07.294949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3a7e-a465-42f8-b774-0503aa6ee762 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.295306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3a7e-a465-42f8-b774-0503aa6ee762 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.295725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3a7e-a465-42f8-b774-0503aa6ee762 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.315240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-39439298-cd8a-46d7-86c8-05f689739ecc None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:07.316842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-39439298-cd8a-46d7-86c8-05f689739ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:07.318526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e3a7e-a465-42f8-b774-0503aa6ee762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-777e3a7e-a465-42f8-b774-0503aa6ee762 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:07.325708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:07.326648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:07.327464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 169/340] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:07.332605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3a7e-a465-42f8-b774-0503aa6ee762 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:07.405979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 172/341] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:07.407159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39439298-cd8a-46d7-86c8-05f689739ecc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:07.484699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:07.513379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:07.530246 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3a7e-a465-42f8-b774-0503aa6ee762 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:07.582018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404747eb-74ee-4dde-b97f-a88e44e21d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:07.582018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404747eb-74ee-4dde-b97f-a88e44e21d60 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.582316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404747eb-74ee-4dde-b97f-a88e44e21d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.582398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404747eb-74ee-4dde-b97f-a88e44e21d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.583143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404747eb-74ee-4dde-b97f-a88e44e21d60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:07.583454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404747eb-74ee-4dde-b97f-a88e44e21d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:07.586204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404747eb-74ee-4dde-b97f-a88e44e21d60 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:07.597022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 170/342] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:07.597620 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404747eb-74ee-4dde-b97f-a88e44e21d60 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:07.607359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39439298-cd8a-46d7-86c8-05f689739ecc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:07.645312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea48e8c-8283-4371-b532-865977fd07a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:07.647171 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48e8c-8283-4371-b532-865977fd07a8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.647687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48e8c-8283-4371-b532-865977fd07a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.648178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48e8c-8283-4371-b532-865977fd07a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.659629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea48e8c-8283-4371-b532-865977fd07a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-cea48e8c-8283-4371-b532-865977fd07a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:07.668939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:07.669835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:07.670642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:07.673023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 173/343] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:00:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:07.674026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea48e8c-8283-4371-b532-865977fd07a8 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:07.855132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404747eb-74ee-4dde-b97f-a88e44e21d60 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:07.879666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea48e8c-8283-4371-b532-865977fd07a8 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:07.915480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:07.929364 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933bfc4-ab4c-4122-8b72-0dcaeb3c6554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:07.930179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933bfc4-ab4c-4122-8b72-0dcaeb3c6554 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.930467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933bfc4-ab4c-4122-8b72-0dcaeb3c6554 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.930749 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933bfc4-ab4c-4122-8b72-0dcaeb3c6554 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.946363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:07.954533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933bfc4-ab4c-4122-8b72-0dcaeb3c6554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:07.962290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c64675-4c3b-4094-b6ba-15165c0f47c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:07.963227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64675-4c3b-4094-b6ba-15165c0f47c3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-3933bfc4-ab4c-4122-8b72-0dcaeb3c6554 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:07.963366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:07.964268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 06:00:07.965147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:07.965837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64675-4c3b-4094-b6ba-15165c0f47c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:07.965837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64675-4c3b-4094-b6ba-15165c0f47c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:07.965959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 171/344] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:07.971469 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933bfc4-ab4c-4122-8b72-0dcaeb3c6554 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.090120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c64675-4c3b-4094-b6ba-15165c0f47c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.091757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c64675-4c3b-4094-b6ba-15165c0f47c3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.099766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933bfc4-ab4c-4122-8b72-0dcaeb3c6554 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.143751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63191a4e-1021-4e78-a4e5-8402bcf2621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.144353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63191a4e-1021-4e78-a4e5-8402bcf2621a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.144674 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63191a4e-1021-4e78-a4e5-8402bcf2621a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.145061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63191a4e-1021-4e78-a4e5-8402bcf2621a None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.145829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63191a4e-1021-4e78-a4e5-8402bcf2621a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:08.146739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63191a4e-1021-4e78-a4e5-8402bcf2621a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.148287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63191a4e-1021-4e78-a4e5-8402bcf2621a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.160653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 172/345] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:08.160653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63191a4e-1021-4e78-a4e5-8402bcf2621a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.228993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 174/346] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:08.230846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f7e5-26ff-452a-b75c-9d7c45e0a98b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.231326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f7e5-26ff-452a-b75c-9d7c45e0a98b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.231807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f7e5-26ff-452a-b75c-9d7c45e0a98b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.233923 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 175/347] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:08.235116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f7e5-26ff-452a-b75c-9d7c45e0a98b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.241117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.258121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.298951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63191a4e-1021-4e78-a4e5-8402bcf2621a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.341216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342870a-884a-4374-b7a7-bbae3023ace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.345874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342870a-884a-4374-b7a7-bbae3023ace9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.346187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342870a-884a-4374-b7a7-bbae3023ace9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.346476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342870a-884a-4374-b7a7-bbae3023ace9 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.347274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342870a-884a-4374-b7a7-bbae3023ace9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:08.347564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342870a-884a-4374-b7a7-bbae3023ace9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.348980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342870a-884a-4374-b7a7-bbae3023ace9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.357897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 173/348] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:08.358786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342870a-884a-4374-b7a7-bbae3023ace9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.383628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f7e5-26ff-452a-b75c-9d7c45e0a98b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.442727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d544d-af37-4201-939b-ba0aa76cbf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.444772 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d544d-af37-4201-939b-ba0aa76cbf25 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.445619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d544d-af37-4201-939b-ba0aa76cbf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.446365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d544d-af37-4201-939b-ba0aa76cbf25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.494273 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342870a-884a-4374-b7a7-bbae3023ace9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.522390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.539198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e33867-df57-4cfb-98f0-a78451bdb305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.540073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e33867-df57-4cfb-98f0-a78451bdb305 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.540364 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e33867-df57-4cfb-98f0-a78451bdb305 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.541215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d544d-af37-4201-939b-ba0aa76cbf25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.542827 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e33867-df57-4cfb-98f0-a78451bdb305 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.543122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d544d-af37-4201-939b-ba0aa76cbf25 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.544193 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e33867-df57-4cfb-98f0-a78451bdb305 None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.545856 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e33867-df57-4cfb-98f0-a78451bdb305 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.548505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 174/349] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:08.549878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098c525-406d-4a7d-957b-a2a81ba1ddf8 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.550165 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098c525-406d-4a7d-957b-a2a81ba1ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.550444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098c525-406d-4a7d-957b-a2a81ba1ddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.562289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.575404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e098c525-406d-4a7d-957b-a2a81ba1ddf8 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:08.576731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e098c525-406d-4a7d-957b-a2a81ba1ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:08.674576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 175/350] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:08.675981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098c525-406d-4a7d-957b-a2a81ba1ddf8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.678824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 176/351] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:08.679935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d544d-af37-4201-939b-ba0aa76cbf25 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.804719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d544d-af37-4201-939b-ba0aa76cbf25 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.805553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098c525-406d-4a7d-957b-a2a81ba1ddf8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.822427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.832927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.847028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e09f99-7995-4937-b153-d615cabb9031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.848005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09f99-7995-4937-b153-d615cabb9031 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.848286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09f99-7995-4937-b153-d615cabb9031 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.848559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09f99-7995-4937-b153-d615cabb9031 None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.850803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa452b7e-3ef9-45b5-908a-73555449e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.851693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452b7e-3ef9-45b5-908a-73555449e9ce None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.851983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452b7e-3ef9-45b5-908a-73555449e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.852266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452b7e-3ef9-45b5-908a-73555449e9ce None admin] PATH_INFO: `/v3/users/e914b868c44045babd511da269a8fead` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.853933 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa452b7e-3ef9-45b5-908a-73555449e9ce None admin] RBAC: Authorizing `identity:get_user(user_id=e914b868c44045babd511da269a8fead)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.855535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa452b7e-3ef9-45b5-908a-73555449e9ce None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.855955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e09f99-7995-4937-b153-d615cabb9031 None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.857538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 176/352] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/users/e914b868c44045babd511da269a8fead => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:08.857672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e09f99-7995-4937-b153-d615cabb9031 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.858525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c595f3f-0c58-4ab8-9596-6059befd85b3 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.858815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c595f3f-0c58-4ab8-9596-6059befd85b3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.859269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c595f3f-0c58-4ab8-9596-6059befd85b3 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.859375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 177/353] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:08.860324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 177/354] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:08.861064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c595f3f-0c58-4ab8-9596-6059befd85b3 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.869592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e09f99-7995-4937-b153-d615cabb9031 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.984543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c595f3f-0c58-4ab8-9596-6059befd85b3 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:09.005334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e09f99-7995-4937-b153-d615cabb9031 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:09.030896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66451878-16a0-4b2e-9095-e78f865c230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:09.031707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451878-16a0-4b2e-9095-e78f865c230b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.031997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451878-16a0-4b2e-9095-e78f865c230b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.032274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451878-16a0-4b2e-9095-e78f865c230b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.045854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66451878-16a0-4b2e-9095-e78f865c230b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:09.049202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680ae5e-40d4-4dc9-a212-52a19f57a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:09.050064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680ae5e-40d4-4dc9-a212-52a19f57a70b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.050347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680ae5e-40d4-4dc9-a212-52a19f57a70b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.050636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680ae5e-40d4-4dc9-a212-52a19f57a70b None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.051856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680ae5e-40d4-4dc9-a212-52a19f57a70b None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:09.053813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680ae5e-40d4-4dc9-a212-52a19f57a70b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-66451878-16a0-4b2e-9095-e78f865c230b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:09.053926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:09.054857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:09.055757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 178/355] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:09.056469 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66451878-16a0-4b2e-9095-e78f865c230b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:09.056547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 178/356] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:09.063641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2043ac-c779-4b25-99fc-56aceb1b8612 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.064043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2043ac-c779-4b25-99fc-56aceb1b8612 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.064382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2043ac-c779-4b25-99fc-56aceb1b8612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.084513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5b2043ac-c779-4b25-99fc-56aceb1b8612 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:09.086094 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5b2043ac-c779-4b25-99fc-56aceb1b8612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:09.121055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:09.140918 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:09.171689 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 179/357] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:09.172959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2043ac-c779-4b25-99fc-56aceb1b8612 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:09.198129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66451878-16a0-4b2e-9095-e78f865c230b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:09.245396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aacefb-9315-4a8b-acba-86c2a510bc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:09.246217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aacefb-9315-4a8b-acba-86c2a510bc29 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.246506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aacefb-9315-4a8b-acba-86c2a510bc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.246790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aacefb-9315-4a8b-acba-86c2a510bc29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.247629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aacefb-9315-4a8b-acba-86c2a510bc29 None admin] RBAC: Adding query filter params (role.id=bee6c92a21d64b28b852f8719be02e65, user.id=e914b868c44045babd511da269a8fead, scope.system=all) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:09.247947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aacefb-9315-4a8b-acba-86c2a510bc29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:09.249495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aacefb-9315-4a8b-acba-86c2a510bc29 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:09.263281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 179/358] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jun 20 06:00:09 2022] GET /identity/v3/role_assignments?user.id=e914b868c44045babd511da269a8fead&scope.system=all&role.id=bee6c92a21d64b28b852f8719be02e65 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:09.269633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aacefb-9315-4a8b-acba-86c2a510bc29 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:09.295457 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2043ac-c779-4b25-99fc-56aceb1b8612 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:09.345239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd9a6-bc91-4908-9d9e-378479cd6aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:09.346074 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd9a6-bc91-4908-9d9e-378479cd6aff None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.347233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd9a6-bc91-4908-9d9e-378479cd6aff None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.347734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd9a6-bc91-4908-9d9e-378479cd6aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.348859 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dd9a6-bc91-4908-9d9e-378479cd6aff None admin] RBAC: Adding query filter params (group.id=5f81809573144288909840fa605d3c61, role.id=f5a5bdf6fee0438391dd54c5b545305e, scope.project.id=9f140c317e2e4605b3c3ef8420147900) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:09.349319 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dd9a6-bc91-4908-9d9e-378479cd6aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:09.350898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dd9a6-bc91-4908-9d9e-378479cd6aff None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:09.357506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 180/359] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jun 20 06:00:09 2022] GET /identity/v3/role_assignments?group.id=5f81809573144288909840fa605d3c61&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:09.358449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd9a6-bc91-4908-9d9e-378479cd6aff None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:09.420955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aacefb-9315-4a8b-acba-86c2a510bc29 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:09.428120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:09.433048 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:09.470975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c78a2-7504-4c77-8ae2-cd5d329bba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:09.471683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c78a2-7504-4c77-8ae2-cd5d329bba61 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.471971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c78a2-7504-4c77-8ae2-cd5d329bba61 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.472252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c78a2-7504-4c77-8ae2-cd5d329bba61 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.473093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c78a2-7504-4c77-8ae2-cd5d329bba61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:09.473919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c78a2-7504-4c77-8ae2-cd5d329bba61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:09.474946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c78a2-7504-4c77-8ae2-cd5d329bba61 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:09.486730 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 180/360] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:09.493204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf98d02-eed9-4f2d-99c0-59b0394cb37c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.493412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf98d02-eed9-4f2d-99c0-59b0394cb37c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.493694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf98d02-eed9-4f2d-99c0-59b0394cb37c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.495240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 181/361] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:09.496067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf98d02-eed9-4f2d-99c0-59b0394cb37c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:09.504295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd9a6-bc91-4908-9d9e-378479cd6aff None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:09.543380 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0487a4-e382-4fba-a5a9-f66953533f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:09.544630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0487a4-e382-4fba-a5a9-f66953533f8c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.545163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0487a4-e382-4fba-a5a9-f66953533f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.545450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0487a4-e382-4fba-a5a9-f66953533f8c None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.546712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0487a4-e382-4fba-a5a9-f66953533f8c None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:09.548176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0487a4-e382-4fba-a5a9-f66953533f8c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:09.549867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 181/362] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:09 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:09.550644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0487a4-e382-4fba-a5a9-f66953533f8c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:09.628106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf98d02-eed9-4f2d-99c0-59b0394cb37c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:09.673328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0487a4-e382-4fba-a5a9-f66953533f8c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:09.678115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32280c46-311a-4d67-a57f-f2a512594498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:09.679250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32280c46-311a-4d67-a57f-f2a512594498 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.679793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32280c46-311a-4d67-a57f-f2a512594498 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.680318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32280c46-311a-4d67-a57f-f2a512594498 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.684509 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:09.696605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32280c46-311a-4d67-a57f-f2a512594498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-32280c46-311a-4d67-a57f-f2a512594498 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:09.705333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:09.706281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:09.707107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:09.713011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 182/363] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:00:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:09.713011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584713-7909-439c-b550-1102c6fb0e6f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.713011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584713-7909-439c-b550-1102c6fb0e6f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.713335 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584713-7909-439c-b550-1102c6fb0e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.719365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d3678-343d-4430-beb0-b64e846a1440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:09.720029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d3678-343d-4430-beb0-b64e846a1440 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.720319 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d3678-343d-4430-beb0-b64e846a1440 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.720752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d3678-343d-4430-beb0-b64e846a1440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.734813 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-93584713-7909-439c-b550-1102c6fb0e6f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:09.736151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-93584713-7909-439c-b550-1102c6fb0e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:09.763287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:09.810828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d3678-343d-4430-beb0-b64e846a1440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:09.812929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d3678-343d-4430-beb0-b64e846a1440 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:09.824301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 183/364] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:09.825398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93584713-7909-439c-b550-1102c6fb0e6f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:09.937686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 182/365] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:09.938631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d3678-343d-4430-beb0-b64e846a1440 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:09.954095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93584713-7909-439c-b550-1102c6fb0e6f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:09.955387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:09.992480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592c54-2666-415c-be94-014f79b5071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:09.993183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592c54-2666-415c-be94-014f79b5071f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:09.993464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592c54-2666-415c-be94-014f79b5071f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:09.993746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592c54-2666-415c-be94-014f79b5071f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:09.994600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6592c54-2666-415c-be94-014f79b5071f None admin] RBAC: Adding query filter params (group.id=5f81809573144288909840fa605d3c61, role.id=0af0bb9954e74b6c9158c0ea76a2c7a5, scope.project.id=9f140c317e2e4605b3c3ef8420147900) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:09.994920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6592c54-2666-415c-be94-014f79b5071f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:09.996831 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6592c54-2666-415c-be94-014f79b5071f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:10.004237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 184/366] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jun 20 06:00:09 2022] GET /identity/v3/role_assignments?group.id=5f81809573144288909840fa605d3c61&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:10.005133 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592c54-2666-415c-be94-014f79b5071f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:10.047345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:10.078656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d3678-343d-4430-beb0-b64e846a1440 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:10.125452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4390dc-424f-4d60-bf66-395eca17d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:10.126155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4390dc-424f-4d60-bf66-395eca17d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.126451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4390dc-424f-4d60-bf66-395eca17d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.126730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4390dc-424f-4d60-bf66-395eca17d2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.127510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4390dc-424f-4d60-bf66-395eca17d2b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:10.127824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4390dc-424f-4d60-bf66-395eca17d2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:10.129522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4390dc-424f-4d60-bf66-395eca17d2b4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:10.139504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 183/367] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:10.140437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4390dc-424f-4d60-bf66-395eca17d2b4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:10.168500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592c54-2666-415c-be94-014f79b5071f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:10.231450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f663a18-2590-44f5-b4b8-fa628cfe5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:10.232729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f663a18-2590-44f5-b4b8-fa628cfe5123 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.233296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f663a18-2590-44f5-b4b8-fa628cfe5123 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.233594 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f663a18-2590-44f5-b4b8-fa628cfe5123 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.234631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:10.248124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f663a18-2590-44f5-b4b8-fa628cfe5123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-8f663a18-2590-44f5-b4b8-fa628cfe5123 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:10.256932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:10.257854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:10.258678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 185/368] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:10.259360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f663a18-2590-44f5-b4b8-fa628cfe5123 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:10.294010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4390dc-424f-4d60-bf66-395eca17d2b4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:10.341574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61d100-a4c8-4bc7-a763-65e049cf523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:10.342949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d100-a4c8-4bc7-a763-65e049cf523b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.343439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d100-a4c8-4bc7-a763-65e049cf523b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.344353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d100-a4c8-4bc7-a763-65e049cf523b None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.345923 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61d100-a4c8-4bc7-a763-65e049cf523b None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:10.347719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61d100-a4c8-4bc7-a763-65e049cf523b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:10.350052 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 184/369] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:10 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:10.351243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61d100-a4c8-4bc7-a763-65e049cf523b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:10.364060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:10.384717 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f663a18-2590-44f5-b4b8-fa628cfe5123 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:10.422342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f866bc1-894b-4a35-80c0-66b7e16f327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:10.423007 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f866bc1-894b-4a35-80c0-66b7e16f327e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.423296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f866bc1-894b-4a35-80c0-66b7e16f327e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.423584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f866bc1-894b-4a35-80c0-66b7e16f327e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.468114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61d100-a4c8-4bc7-a763-65e049cf523b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:10.494914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f866bc1-894b-4a35-80c0-66b7e16f327e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:10.496322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f866bc1-894b-4a35-80c0-66b7e16f327e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:10.507218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c597d6-313d-47d7-b293-0fd7df5e2399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:10.508262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c597d6-313d-47d7-b293-0fd7df5e2399 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.508777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c597d6-313d-47d7-b293-0fd7df5e2399 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.509684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c597d6-313d-47d7-b293-0fd7df5e2399 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.510662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c597d6-313d-47d7-b293-0fd7df5e2399 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:10.511184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c597d6-313d-47d7-b293-0fd7df5e2399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:10.512791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c597d6-313d-47d7-b293-0fd7df5e2399 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:10.519749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:10.526112 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 185/370] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:10.527217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c597d6-313d-47d7-b293-0fd7df5e2399 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:10.597122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:10.609223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 186/371] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:10.610227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f866bc1-894b-4a35-80c0-66b7e16f327e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:10.658605 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c597d6-313d-47d7-b293-0fd7df5e2399 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:10.698428 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756d1b1-1681-4a4a-892a-6f23c222e17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:10.699742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756d1b1-1681-4a4a-892a-6f23c222e17a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.700243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756d1b1-1681-4a4a-892a-6f23c222e17a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.700759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756d1b1-1681-4a4a-892a-6f23c222e17a None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.702365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756d1b1-1681-4a4a-892a-6f23c222e17a None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:10.704080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756d1b1-1681-4a4a-892a-6f23c222e17a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:10.706453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 186/372] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:10 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:10.707509 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756d1b1-1681-4a4a-892a-6f23c222e17a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:10.722729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f866bc1-894b-4a35-80c0-66b7e16f327e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:10.767707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed6fe6-e8e3-482d-a76d-fbf6c1cd1e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:10.768603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed6fe6-e8e3-482d-a76d-fbf6c1cd1e34 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.769116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed6fe6-e8e3-482d-a76d-fbf6c1cd1e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.769543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed6fe6-e8e3-482d-a76d-fbf6c1cd1e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.803527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:10.842458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:10.847654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756d1b1-1681-4a4a-892a-6f23c222e17a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:10.876812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed6fe6-e8e3-482d-a76d-fbf6c1cd1e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:10.878970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed6fe6-e8e3-482d-a76d-fbf6c1cd1e34 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:10.887745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c684e2-9d15-48e6-a71c-7c8e142c5ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:10.888780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c684e2-9d15-48e6-a71c-7c8e142c5ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.889073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c684e2-9d15-48e6-a71c-7c8e142c5ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.889356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c684e2-9d15-48e6-a71c-7c8e142c5ca2 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.892794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c684e2-9d15-48e6-a71c-7c8e142c5ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:10.894387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c684e2-9d15-48e6-a71c-7c8e142c5ca2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:10.896159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 187/373] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:10 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:10.896980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c684e2-9d15-48e6-a71c-7c8e142c5ca2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:11.010360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 187/374] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:11.011227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed6fe6-e8e3-482d-a76d-fbf6c1cd1e34 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:11.030641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c684e2-9d15-48e6-a71c-7c8e142c5ca2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:11.072954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfff7f2-76bb-43f9-8089-c5aa0b4eb67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:11.073614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfff7f2-76bb-43f9-8089-c5aa0b4eb67e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.073947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfff7f2-76bb-43f9-8089-c5aa0b4eb67e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.074232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfff7f2-76bb-43f9-8089-c5aa0b4eb67e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.075141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfff7f2-76bb-43f9-8089-c5aa0b4eb67e None admin] RBAC: Adding query filter params (group.id=5f81809573144288909840fa605d3c61, role.id=f5a5bdf6fee0438391dd54c5b545305e, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:11.075388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfff7f2-76bb-43f9-8089-c5aa0b4eb67e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:11.076878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfff7f2-76bb-43f9-8089-c5aa0b4eb67e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:11.079917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:11.092344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 188/375] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jun 20 06:00:10 2022] GET /identity/v3/role_assignments?group.id=5f81809573144288909840fa605d3c61&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:11.093384 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfff7f2-76bb-43f9-8089-c5aa0b4eb67e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:11.109300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:11.131084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed6fe6-e8e3-482d-a76d-fbf6c1cd1e34 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:11.171572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63788e17-834d-4b9a-8c31-a8a6bf7b5097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:11.172841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63788e17-834d-4b9a-8c31-a8a6bf7b5097 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.173332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63788e17-834d-4b9a-8c31-a8a6bf7b5097 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.173826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63788e17-834d-4b9a-8c31-a8a6bf7b5097 None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.175237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63788e17-834d-4b9a-8c31-a8a6bf7b5097 None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:11.176929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63788e17-834d-4b9a-8c31-a8a6bf7b5097 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:11.179372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 188/376] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:11 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:11.185559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63788e17-834d-4b9a-8c31-a8a6bf7b5097 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:11.246839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfff7f2-76bb-43f9-8089-c5aa0b4eb67e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:11.291645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065aa5e-69de-4023-aef2-e3e51f182541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:11.292437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065aa5e-69de-4023-aef2-e3e51f182541 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.292753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065aa5e-69de-4023-aef2-e3e51f182541 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.293026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065aa5e-69de-4023-aef2-e3e51f182541 None admin] PATH_INFO: `/v3/projects/bc8cc051ad1a43a898b15611374a54c1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.294292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065aa5e-69de-4023-aef2-e3e51f182541 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cc051ad1a43a898b15611374a54c1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:11.295766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065aa5e-69de-4023-aef2-e3e51f182541 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:11.298082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 189/377] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:11 2022] GET /identity/v3/projects/bc8cc051ad1a43a898b15611374a54c1 => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:11.303884 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065aa5e-69de-4023-aef2-e3e51f182541 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:11.304559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63788e17-834d-4b9a-8c31-a8a6bf7b5097 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:11.361275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a25c6-5a4f-493d-a165-9ac4d97a01eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:11.362096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a25c6-5a4f-493d-a165-9ac4d97a01eb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.362479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a25c6-5a4f-493d-a165-9ac4d97a01eb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.362927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a25c6-5a4f-493d-a165-9ac4d97a01eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.365306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a25c6-5a4f-493d-a165-9ac4d97a01eb None admin] RBAC: Adding query filter params (group.id=5f81809573144288909840fa605d3c61, role.id=0af0bb9954e74b6c9158c0ea76a2c7a5, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:11.366321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a25c6-5a4f-493d-a165-9ac4d97a01eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:11.367959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a25c6-5a4f-493d-a165-9ac4d97a01eb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:11.377446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 189/378] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jun 20 06:00:11 2022] GET /identity/v3/role_assignments?group.id=5f81809573144288909840fa605d3c61&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:11.406735 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:11.459186 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065aa5e-69de-4023-aef2-e3e51f182541 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:11.515061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d2e7b-835b-4ab3-af1f-2cb8f19d6276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:11.515948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2e7b-835b-4ab3-af1f-2cb8f19d6276 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.516238 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2e7b-835b-4ab3-af1f-2cb8f19d6276 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.516518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2e7b-835b-4ab3-af1f-2cb8f19d6276 None admin] PATH_INFO: `/v3/groups/83f889fd51a54a08b6d61aff3835d901` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.525074 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d2e7b-835b-4ab3-af1f-2cb8f19d6276 None admin] RBAC: Authorizing `identity:get_group(group_id=83f889fd51a54a08b6d61aff3835d901)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:11.526636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d2e7b-835b-4ab3-af1f-2cb8f19d6276 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:11.528764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 190/379] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:11 2022] GET /identity/v3/groups/83f889fd51a54a08b6d61aff3835d901 => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:11.538332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a25c6-5a4f-493d-a165-9ac4d97a01eb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:11.561124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:11.672992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a25c6-5a4f-493d-a165-9ac4d97a01eb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:11.711100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52d4fc-5b66-4a59-8e01-05148a9497be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:11.711771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52d4fc-5b66-4a59-8e01-05148a9497be None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.712058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52d4fc-5b66-4a59-8e01-05148a9497be None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.712339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52d4fc-5b66-4a59-8e01-05148a9497be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.713214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52d4fc-5b66-4a59-8e01-05148a9497be None admin] RBAC: Adding query filter params (group.id=83f889fd51a54a08b6d61aff3835d901, role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=bc8cc051ad1a43a898b15611374a54c1) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:11.713532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52d4fc-5b66-4a59-8e01-05148a9497be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:11.715079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52d4fc-5b66-4a59-8e01-05148a9497be None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:11.721210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 190/380] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jun 20 06:00:11 2022] GET /identity/v3/role_assignments?group.id=83f889fd51a54a08b6d61aff3835d901&scope.project.id=bc8cc051ad1a43a898b15611374a54c1&role.id=efc16976111d431c9173186cbd0e6c24 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:11.904274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da19aee-9671-4b6b-acaf-7957a2ed3699 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.905045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da19aee-9671-4b6b-acaf-7957a2ed3699 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.905532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da19aee-9671-4b6b-acaf-7957a2ed3699 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.907371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 191/381] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:11.914585 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd313-2321-4a7f-9e51-cb0dc7c4f0a1 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:11.914866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd313-2321-4a7f-9e51-cb0dc7c4f0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:11.915147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd313-2321-4a7f-9e51-cb0dc7c4f0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:11.934712 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f44cd313-2321-4a7f-9e51-cb0dc7c4f0a1 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:11.936262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f44cd313-2321-4a7f-9e51-cb0dc7c4f0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:12.018707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 191/382] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:12.042987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da19aee-9671-4b6b-acaf-7957a2ed3699 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:12.172135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da19aee-9671-4b6b-acaf-7957a2ed3699 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:12.218685 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:12.225383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff9d01-aba8-4c9b-95cb-09957b2ecbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:12.226202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff9d01-aba8-4c9b-95cb-09957b2ecbcf None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:12.226491 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff9d01-aba8-4c9b-95cb-09957b2ecbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:12.226767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff9d01-aba8-4c9b-95cb-09957b2ecbcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:12.242461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff9d01-aba8-4c9b-95cb-09957b2ecbcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-b1ff9d01-aba8-4c9b-95cb-09957b2ecbcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:12.250288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:12.251191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:12.252387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 192/383] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:12.257504 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cd313-2321-4a7f-9e51-cb0dc7c4f0a1 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:12.269910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:12.387133 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cd313-2321-4a7f-9e51-cb0dc7c4f0a1 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:12.426876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce533c-52ba-45f5-84da-97ef727ceb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:12.428451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce533c-52ba-45f5-84da-97ef727ceb88 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:12.428570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce533c-52ba-45f5-84da-97ef727ceb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:12.428868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce533c-52ba-45f5-84da-97ef727ceb88 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:12.429628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce533c-52ba-45f5-84da-97ef727ceb88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:12.429941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce533c-52ba-45f5-84da-97ef727ceb88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:12.431338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce533c-52ba-45f5-84da-97ef727ceb88 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:12.441454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 192/384] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:12.448486 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff9d01-aba8-4c9b-95cb-09957b2ecbcf None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:12.457494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd2dd-7b20-48fd-83f8-030ef9db0c59 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:12.457804 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd2dd-7b20-48fd-83f8-030ef9db0c59 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:12.458070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bd2dd-7b20-48fd-83f8-030ef9db0c59 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:12.459583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 193/385] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:12.465180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97644892-d464-4783-aa50-4605f2b8ea95 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:12.465475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97644892-d464-4783-aa50-4605f2b8ea95 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:12.465764 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97644892-d464-4783-aa50-4605f2b8ea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:12.491113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-97644892-d464-4783-aa50-4605f2b8ea95 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:12.492653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-97644892-d464-4783-aa50-4605f2b8ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:12.613636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff9d01-aba8-4c9b-95cb-09957b2ecbcf None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:12.614523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:12.625876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 194/386] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:12.662596 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97644892-d464-4783-aa50-4605f2b8ea95 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:12.669042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3df34e-731a-4866-95c0-aa1486865681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:12.670465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df34e-731a-4866-95c0-aa1486865681 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:12.670912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df34e-731a-4866-95c0-aa1486865681 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:12.672292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df34e-731a-4866-95c0-aa1486865681 None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:12.674147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3df34e-731a-4866-95c0-aa1486865681 None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:12.675752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3df34e-731a-4866-95c0-aa1486865681 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:12.681794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 193/387] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:12 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:12.687222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3df34e-731a-4866-95c0-aa1486865681 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:12.810064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:12.812090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97644892-d464-4783-aa50-4605f2b8ea95 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:12.855407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32d50d-6892-448a-8e3f-17b0c83b1428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:12.856464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32d50d-6892-448a-8e3f-17b0c83b1428 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:12.856911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32d50d-6892-448a-8e3f-17b0c83b1428 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:12.857426 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32d50d-6892-448a-8e3f-17b0c83b1428 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:12.878016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32d50d-6892-448a-8e3f-17b0c83b1428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:12.882883 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3df34e-731a-4866-95c0-aa1486865681 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4f32d50d-6892-448a-8e3f-17b0c83b1428 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:12.888120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:12.889248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:12.890160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 195/388] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:00:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:12.895824 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32d50d-6892-448a-8e3f-17b0c83b1428 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:12.953607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6f3a1-9ac6-4493-b6e5-1db64d3dad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:12.955813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6f3a1-9ac6-4493-b6e5-1db64d3dad42 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:12.957421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6f3a1-9ac6-4493-b6e5-1db64d3dad42 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:12.957872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6f3a1-9ac6-4493-b6e5-1db64d3dad42 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:12.960291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6f3a1-9ac6-4493-b6e5-1db64d3dad42 None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:12.965863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6f3a1-9ac6-4493-b6e5-1db64d3dad42 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:12.968629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 194/389] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:12 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:12.974799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6f3a1-9ac6-4493-b6e5-1db64d3dad42 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:13.010026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:13.064863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32d50d-6892-448a-8e3f-17b0c83b1428 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:13.111853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdae5d-0bb2-48e4-8973-d3de0a7567c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:13.113905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdae5d-0bb2-48e4-8973-d3de0a7567c4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.114518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdae5d-0bb2-48e4-8973-d3de0a7567c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.116765 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdae5d-0bb2-48e4-8973-d3de0a7567c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.117685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdae5d-0bb2-48e4-8973-d3de0a7567c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:13.118347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdae5d-0bb2-48e4-8973-d3de0a7567c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:13.122512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdae5d-0bb2-48e4-8973-d3de0a7567c4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:13.135921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 196/390] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:13.142250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdae5d-0bb2-48e4-8973-d3de0a7567c4 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:13.154623 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6f3a1-9ac6-4493-b6e5-1db64d3dad42 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:13.204330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:13.220239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46bfd1-8b6f-4a6f-856f-b4c6501681e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:13.223020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46bfd1-8b6f-4a6f-856f-b4c6501681e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.223247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46bfd1-8b6f-4a6f-856f-b4c6501681e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.223509 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46bfd1-8b6f-4a6f-856f-b4c6501681e4 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900/groups/5f81809573144288909840fa605d3c61/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.227374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46bfd1-8b6f-4a6f-856f-b4c6501681e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f140c317e2e4605b3c3ef8420147900, group_id=5f81809573144288909840fa605d3c61, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:13.229533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46bfd1-8b6f-4a6f-856f-b4c6501681e4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:13.254118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 195/391] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jun 20 06:00:12 2022] PUT /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900/groups/5f81809573144288909840fa605d3c61/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:13.338839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdae5d-0bb2-48e4-8973-d3de0a7567c4 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:13.374407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:13.395426 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4f0be-db26-4374-94e9-5daa87a49682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:13.397556 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4f0be-db26-4374-94e9-5daa87a49682 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.398051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4f0be-db26-4374-94e9-5daa87a49682 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.398546 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4f0be-db26-4374-94e9-5daa87a49682 None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.400015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4f0be-db26-4374-94e9-5daa87a49682 None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:13.401724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4f0be-db26-4374-94e9-5daa87a49682 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:13.403978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 197/392] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:13 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:13.411458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46bfd1-8b6f-4a6f-856f-b4c6501681e4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:13.520299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46bfd1-8b6f-4a6f-856f-b4c6501681e4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:13.556350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15914a4c-f03a-4eae-8223-1b1cac7bf27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:13.557245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15914a4c-f03a-4eae-8223-1b1cac7bf27f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.557531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15914a4c-f03a-4eae-8223-1b1cac7bf27f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.557813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15914a4c-f03a-4eae-8223-1b1cac7bf27f None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.559015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15914a4c-f03a-4eae-8223-1b1cac7bf27f None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:13.560476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15914a4c-f03a-4eae-8223-1b1cac7bf27f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:13.563903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 196/393] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:13 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:13.569997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4f0be-db26-4374-94e9-5daa87a49682 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:13.730055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4f0be-db26-4374-94e9-5daa87a49682 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:13.745585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48cf58-c57e-4b4b-bd6d-1cebf4fb2b98 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.746118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48cf58-c57e-4b4b-bd6d-1cebf4fb2b98 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.746402 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48cf58-c57e-4b4b-bd6d-1cebf4fb2b98 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.748063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 197/394] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:13.766114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87ed88-1cb1-45d9-a9a9-4e1b1ea22c72 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.766408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87ed88-1cb1-45d9-a9a9-4e1b1ea22c72 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.766693 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87ed88-1cb1-45d9-a9a9-4e1b1ea22c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.790276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c7d87-f758-417f-b3d7-900e75935cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:13.791448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7d87-f758-417f-b3d7-900e75935cd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.791910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7d87-f758-417f-b3d7-900e75935cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.792378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7d87-f758-417f-b3d7-900e75935cd9 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900/groups/5f81809573144288909840fa605d3c61/roles/0af0bb9954e74b6c9158c0ea76a2c7a5` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.793656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8a87ed88-1cb1-45d9-a9a9-4e1b1ea22c72 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:13.794900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8a87ed88-1cb1-45d9-a9a9-4e1b1ea22c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:13.795222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c7d87-f758-417f-b3d7-900e75935cd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f140c317e2e4605b3c3ef8420147900, group_id=5f81809573144288909840fa605d3c61, role_id=0af0bb9954e74b6c9158c0ea76a2c7a5)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:13.796889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c7d87-f758-417f-b3d7-900e75935cd9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:13.827881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 198/395] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jun 20 06:00:13 2022] PUT /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900/groups/5f81809573144288909840fa605d3c61/roles/0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:13.862681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:13.886758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 198/396] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:13.921576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c7d87-f758-417f-b3d7-900e75935cd9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.009978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:14.079979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c7d87-f758-417f-b3d7-900e75935cd9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.119108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b1b0e-d14f-42ff-9843-3f682c6fdfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.120179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b1b0e-d14f-42ff-9843-3f682c6fdfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.120630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b1b0e-d14f-42ff-9843-3f682c6fdfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.121052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b1b0e-d14f-42ff-9843-3f682c6fdfa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.132013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b1b0e-d14f-42ff-9843-3f682c6fdfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ce1b1b0e-d14f-42ff-9843-3f682c6fdfa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:14.139979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:14.141097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:14.142182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:14.144530 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 199/397] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:14.150719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87ed88-1cb1-45d9-a9a9-4e1b1ea22c72 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.300170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87ed88-1cb1-45d9-a9a9-4e1b1ea22c72 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.319394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11ae3b-13d8-4f39-bfd0-e38e933d5858 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.319705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11ae3b-13d8-4f39-bfd0-e38e933d5858 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.319970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11ae3b-13d8-4f39-bfd0-e38e933d5858 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.321855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 200/398] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:14.327164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebff199-f600-4333-ac2a-1d949d2588b9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.327467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebff199-f600-4333-ac2a-1d949d2588b9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.327754 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebff199-f600-4333-ac2a-1d949d2588b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.347212 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e95a4e-250a-4f9d-b15e-3362a140cd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.347882 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e95a4e-250a-4f9d-b15e-3362a140cd81 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.348164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e95a4e-250a-4f9d-b15e-3362a140cd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.348487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e95a4e-250a-4f9d-b15e-3362a140cd81 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.349630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e95a4e-250a-4f9d-b15e-3362a140cd81 None admin] RBAC: Adding query filter params (name=member) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:14.350391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e95a4e-250a-4f9d-b15e-3362a140cd81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:14.353884 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e95a4e-250a-4f9d-b15e-3362a140cd81 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:14.363393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8ebff199-f600-4333-ac2a-1d949d2588b9 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:14.367297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8ebff199-f600-4333-ac2a-1d949d2588b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:14.373359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 199/399] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:14.381951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e95a4e-250a-4f9d-b15e-3362a140cd81 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.480977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:14.516470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 201/400] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:14.545299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e95a4e-250a-4f9d-b15e-3362a140cd81 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.549769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebff199-f600-4333-ac2a-1d949d2588b9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.586053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aba34a-6d9f-47b7-82c6-2d42ac11802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.586920 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba34a-6d9f-47b7-82c6-2d42ac11802e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.587200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba34a-6d9f-47b7-82c6-2d42ac11802e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.587474 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba34a-6d9f-47b7-82c6-2d42ac11802e None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.588669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aba34a-6d9f-47b7-82c6-2d42ac11802e None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:14.590423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aba34a-6d9f-47b7-82c6-2d42ac11802e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:14.593078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 200/401] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:14 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:14.596388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8789f-dcc7-425a-a1d1-d044145a9a5c None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.597313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8789f-dcc7-425a-a1d1-d044145a9a5c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.597544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8789f-dcc7-425a-a1d1-d044145a9a5c None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.599210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 201/402] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:00:14.600197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8789f-dcc7-425a-a1d1-d044145a9a5c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.634810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:14.700553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebff199-f600-4333-ac2a-1d949d2588b9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.733592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8789f-dcc7-425a-a1d1-d044145a9a5c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.736581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63054667-3ef3-45b6-928f-d786059e3913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.737621 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054667-3ef3-45b6-928f-d786059e3913 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.738057 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054667-3ef3-45b6-928f-d786059e3913 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.738482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054667-3ef3-45b6-928f-d786059e3913 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.749522 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63054667-3ef3-45b6-928f-d786059e3913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:14.753262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-63054667-3ef3-45b6-928f-d786059e3913 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:14.758822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:14.759904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:14.760872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:14.767772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 202/403] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:00:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:14.769252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8d1a-853f-40c8-86c5-0e41a4dd57e2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.769691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8d1a-853f-40c8-86c5-0e41a4dd57e2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.770118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8d1a-853f-40c8-86c5-0e41a4dd57e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.776027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c735e41-738e-4f0a-b0e8-a645d08a0e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.777410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c735e41-738e-4f0a-b0e8-a645d08a0e64 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.777410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c735e41-738e-4f0a-b0e8-a645d08a0e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.777606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c735e41-738e-4f0a-b0e8-a645d08a0e64 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.778846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c735e41-738e-4f0a-b0e8-a645d08a0e64 None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:14.780309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c735e41-738e-4f0a-b0e8-a645d08a0e64 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:14.782454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 202/404] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:14 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:14.783306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c735e41-738e-4f0a-b0e8-a645d08a0e64 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.790644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ff3a8d1a-853f-40c8-86c5-0e41a4dd57e2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:14.792143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ff3a8d1a-853f-40c8-86c5-0e41a4dd57e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:14.864379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 203/405] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:14.865872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a8d1a-853f-40c8-86c5-0e41a4dd57e2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.897528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:14.906480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c735e41-738e-4f0a-b0e8-a645d08a0e64 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:14.947150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41b924-2662-4dc5-8528-23e4ebdd1111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:14.947825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41b924-2662-4dc5-8528-23e4ebdd1111 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:14.948165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41b924-2662-4dc5-8528-23e4ebdd1111 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:14.948443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41b924-2662-4dc5-8528-23e4ebdd1111 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:14.949261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41b924-2662-4dc5-8528-23e4ebdd1111 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:14.949572 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41b924-2662-4dc5-8528-23e4ebdd1111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:14.951061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41b924-2662-4dc5-8528-23e4ebdd1111 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:14.960637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 203/406] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:14.966020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41b924-2662-4dc5-8528-23e4ebdd1111 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:14.982350 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a8d1a-853f-40c8-86c5-0e41a4dd57e2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:15.014475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:15.018868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dfa08-d331-482b-b96f-997fd4752e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:15.020024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dfa08-d331-482b-b96f-997fd4752e4d None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.020511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dfa08-d331-482b-b96f-997fd4752e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.021327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dfa08-d331-482b-b96f-997fd4752e4d None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/groups/5f81809573144288909840fa605d3c61/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.024869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dfa08-d331-482b-b96f-997fd4752e4d None admin] RBAC: Authorizing `identity:create_grant(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a, group_id=5f81809573144288909840fa605d3c61, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:15.026538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dfa08-d331-482b-b96f-997fd4752e4d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:15.043651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 204/407] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jun 20 06:00:14 2022] PUT /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/groups/5f81809573144288909840fa605d3c61/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:15.045030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dfa08-d331-482b-b96f-997fd4752e4d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:15.088917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41b924-2662-4dc5-8528-23e4ebdd1111 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:15.168382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bebce-f749-4b23-8294-7b536759c084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:15.169725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bebce-f749-4b23-8294-7b536759c084 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.170224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bebce-f749-4b23-8294-7b536759c084 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.170719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bebce-f749-4b23-8294-7b536759c084 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.195678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bebce-f749-4b23-8294-7b536759c084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-077bebce-f749-4b23-8294-7b536759c084 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:15.203649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:15.204672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:15.205508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:15.207903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 204/408] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:15.221036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bebce-f749-4b23-8294-7b536759c084 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:15.223708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:15.237505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dfa08-d331-482b-b96f-997fd4752e4d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:15.276899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5f874-152c-436b-9a05-f541e06c65cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:15.277778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5f874-152c-436b-9a05-f541e06c65cb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.278067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5f874-152c-436b-9a05-f541e06c65cb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.278332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5f874-152c-436b-9a05-f541e06c65cb None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.279519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5f874-152c-436b-9a05-f541e06c65cb None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:15.281149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5f874-152c-436b-9a05-f541e06c65cb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:15.283064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 205/409] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:15 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:15.288683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5f874-152c-436b-9a05-f541e06c65cb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:15.345299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bebce-f749-4b23-8294-7b536759c084 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:15.352915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:15.400446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5f874-152c-436b-9a05-f541e06c65cb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:15.405912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b10ef5-cea5-4fc8-a420-8e9f82767f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:15.406603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b10ef5-cea5-4fc8-a420-8e9f82767f99 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.406896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b10ef5-cea5-4fc8-a420-8e9f82767f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.407229 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b10ef5-cea5-4fc8-a420-8e9f82767f99 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.407937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b10ef5-cea5-4fc8-a420-8e9f82767f99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:15.408252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b10ef5-cea5-4fc8-a420-8e9f82767f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:15.410001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b10ef5-cea5-4fc8-a420-8e9f82767f99 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:15.428481 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 205/410] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:15.433841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b10ef5-cea5-4fc8-a420-8e9f82767f99 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:15.439415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f363-232f-4093-ba7c-1f83bfed53a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:15.440599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f363-232f-4093-ba7c-1f83bfed53a1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.441096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f363-232f-4093-ba7c-1f83bfed53a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.441509 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f363-232f-4093-ba7c-1f83bfed53a1 None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.443384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55f363-232f-4093-ba7c-1f83bfed53a1 None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:15.445226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55f363-232f-4093-ba7c-1f83bfed53a1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:15.451713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 206/411] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:15 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:15.453037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f363-232f-4093-ba7c-1f83bfed53a1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:15.513006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:15.559796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f363-232f-4093-ba7c-1f83bfed53a1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:15.595679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995b3c4-4e20-4a00-adca-e8b98b25facd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:15.597053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b3c4-4e20-4a00-adca-e8b98b25facd None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.597533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b3c4-4e20-4a00-adca-e8b98b25facd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.598000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b3c4-4e20-4a00-adca-e8b98b25facd None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/groups/5f81809573144288909840fa605d3c61/roles/0af0bb9954e74b6c9158c0ea76a2c7a5` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.601297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995b3c4-4e20-4a00-adca-e8b98b25facd None admin] RBAC: Authorizing `identity:create_grant(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a, group_id=5f81809573144288909840fa605d3c61, role_id=0af0bb9954e74b6c9158c0ea76a2c7a5)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:15.602695 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b10ef5-cea5-4fc8-a420-8e9f82767f99 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:15.603213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995b3c4-4e20-4a00-adca-e8b98b25facd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:15.638204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038e0a-bc62-4fea-9c99-35aa1ce8509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:15.639169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038e0a-bc62-4fea-9c99-35aa1ce8509d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.639472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038e0a-bc62-4fea-9c99-35aa1ce8509d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.639744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038e0a-bc62-4fea-9c99-35aa1ce8509d None admin] PATH_INFO: `/v3/groups/83f889fd51a54a08b6d61aff3835d901` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.641156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e038e0a-bc62-4fea-9c99-35aa1ce8509d None admin] RBAC: Authorizing `identity:get_group(group_id=83f889fd51a54a08b6d61aff3835d901)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:15.642673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e038e0a-bc62-4fea-9c99-35aa1ce8509d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:15.648938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 206/412] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:15 2022] GET /identity/v3/groups/83f889fd51a54a08b6d61aff3835d901 => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:15.651293 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038e0a-bc62-4fea-9c99-35aa1ce8509d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:15.653577 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 207/413] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jun 20 06:00:15 2022] PUT /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a/groups/5f81809573144288909840fa605d3c61/roles/0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:00:15.695247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:15.771281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038e0a-bc62-4fea-9c99-35aa1ce8509d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:15.809595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4acbe-672d-466d-a538-dd39899b352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:15.810470 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4acbe-672d-466d-a538-dd39899b352f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.810760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4acbe-672d-466d-a538-dd39899b352f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.811040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4acbe-672d-466d-a538-dd39899b352f None admin] PATH_INFO: `/v3/projects/bc8cc051ad1a43a898b15611374a54c1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.812315 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4acbe-672d-466d-a538-dd39899b352f None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cc051ad1a43a898b15611374a54c1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:15.813885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4acbe-672d-466d-a538-dd39899b352f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:15.815729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 207/414] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:15 2022] GET /identity/v3/projects/bc8cc051ad1a43a898b15611374a54c1 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:15.821633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995b3c4-4e20-4a00-adca-e8b98b25facd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:15.864393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292430e-42e2-4c06-ad4b-225e47d560f0 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.865253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292430e-42e2-4c06-ad4b-225e47d560f0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.865581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292430e-42e2-4c06-ad4b-225e47d560f0 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.867253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 208/415] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:15.873223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b40fc0-a8ea-4482-9ff6-9d77852da64f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.873509 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b40fc0-a8ea-4482-9ff6-9d77852da64f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.873799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b40fc0-a8ea-4482-9ff6-9d77852da64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.892481 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-11b40fc0-a8ea-4482-9ff6-9d77852da64f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:15.894135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-11b40fc0-a8ea-4482-9ff6-9d77852da64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:15.977427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 209/416] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:15.984225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:16.002498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995b3c4-4e20-4a00-adca-e8b98b25facd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:16.006744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b40fc0-a8ea-4482-9ff6-9d77852da64f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:16.048686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba1373-4e96-4ed0-820e-fc4908e69efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:16.050020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba1373-4e96-4ed0-820e-fc4908e69efc None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:16.050313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba1373-4e96-4ed0-820e-fc4908e69efc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:16.050599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba1373-4e96-4ed0-820e-fc4908e69efc None admin] PATH_INFO: `/v3/projects/bc8cc051ad1a43a898b15611374a54c1/groups/83f889fd51a54a08b6d61aff3835d901/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:16.054099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba1373-4e96-4ed0-820e-fc4908e69efc None admin] RBAC: Authorizing `identity:create_grant(project_id=bc8cc051ad1a43a898b15611374a54c1, group_id=83f889fd51a54a08b6d61aff3835d901, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:16.055864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba1373-4e96-4ed0-820e-fc4908e69efc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:16.057337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:16.080094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 208/417] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jun 20 06:00:15 2022] PUT /identity/v3/projects/bc8cc051ad1a43a898b15611374a54c1/groups/83f889fd51a54a08b6d61aff3835d901/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:16.155346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b40fc0-a8ea-4482-9ff6-9d77852da64f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:16.205937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c6e5b-aa4b-4c88-a394-89e5c7ee5bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:16.207246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c6e5b-aa4b-4c88-a394-89e5c7ee5bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:16.207763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c6e5b-aa4b-4c88-a394-89e5c7ee5bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:16.208251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c6e5b-aa4b-4c88-a394-89e5c7ee5bb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:16.234070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c6e5b-aa4b-4c88-a394-89e5c7ee5bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-9c9c6e5b-aa4b-4c88-a394-89e5c7ee5bb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:16.243182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:16.244288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:16.245147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:16.247717 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 210/418] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:16.254143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba1373-4e96-4ed0-820e-fc4908e69efc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:16.411807 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba1373-4e96-4ed0-820e-fc4908e69efc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:16.461361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482495b-45f3-4c8c-a482-0cce9b085c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:16.462045 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482495b-45f3-4c8c-a482-0cce9b085c0d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:16.462331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482495b-45f3-4c8c-a482-0cce9b085c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:16.462606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482495b-45f3-4c8c-a482-0cce9b085c0d None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:16.463363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482495b-45f3-4c8c-a482-0cce9b085c0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:16.463674 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482495b-45f3-4c8c-a482-0cce9b085c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:16.465091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482495b-45f3-4c8c-a482-0cce9b085c0d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:16.481062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 209/419] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:16.486422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c6e5b-aa4b-4c88-a394-89e5c7ee5bb6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:16.634561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592061d-0088-426d-abf4-40fc9bd1041c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:16.634913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592061d-0088-426d-abf4-40fc9bd1041c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:16.635125 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592061d-0088-426d-abf4-40fc9bd1041c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:16.636948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 210/420] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:16.642982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c22c1-9ce7-4f6a-848f-03b87eb46dce None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:16.643282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c22c1-9ce7-4f6a-848f-03b87eb46dce None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:16.643555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c22c1-9ce7-4f6a-848f-03b87eb46dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:16.648790 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:16.663885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c6e5b-aa4b-4c88-a394-89e5c7ee5bb6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:16.664720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-675c22c1-9ce7-4f6a-848f-03b87eb46dce None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:16.666211 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-675c22c1-9ce7-4f6a-848f-03b87eb46dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:16.668637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:16.737404 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86746fb8-74a7-44ff-9d14-db50a5e21971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:16.738055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86746fb8-74a7-44ff-9d14-db50a5e21971 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:16.738344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86746fb8-74a7-44ff-9d14-db50a5e21971 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:16.738622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86746fb8-74a7-44ff-9d14-db50a5e21971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:16.818368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 211/421] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:16.849322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86746fb8-74a7-44ff-9d14-db50a5e21971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:16.850974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86746fb8-74a7-44ff-9d14-db50a5e21971 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:16.880248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c22c1-9ce7-4f6a-848f-03b87eb46dce None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:16.960080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:16.975825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 211/422] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:16.981715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86746fb8-74a7-44ff-9d14-db50a5e21971 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:17.017955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c22c1-9ce7-4f6a-848f-03b87eb46dce None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:17.054479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151af36-c04e-4fd4-a959-2db33d4fc1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:17.055294 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151af36-c04e-4fd4-a959-2db33d4fc1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.055575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151af36-c04e-4fd4-a959-2db33d4fc1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.055846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151af36-c04e-4fd4-a959-2db33d4fc1f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.067745 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151af36-c04e-4fd4-a959-2db33d4fc1f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:17.076964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-8151af36-c04e-4fd4-a959-2db33d4fc1f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:17.078986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:17.079956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:17.080806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:17.081429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 212/423] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:00:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:17.086226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151af36-c04e-4fd4-a959-2db33d4fc1f3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:17.242554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86746fb8-74a7-44ff-9d14-db50a5e21971 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:17.242788 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151af36-c04e-4fd4-a959-2db33d4fc1f3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:17.283174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45410e21-ebf0-4180-8fd9-353e08d33fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:17.283769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45410e21-ebf0-4180-8fd9-353e08d33fec None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.284307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45410e21-ebf0-4180-8fd9-353e08d33fec None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.284583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45410e21-ebf0-4180-8fd9-353e08d33fec None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.285375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45410e21-ebf0-4180-8fd9-353e08d33fec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:17.286145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45410e21-ebf0-4180-8fd9-353e08d33fec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:17.288083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45410e21-ebf0-4180-8fd9-353e08d33fec None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:17.297889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 213/424] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:17.303433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45410e21-ebf0-4180-8fd9-353e08d33fec None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:17.334934 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b981f-8882-41cb-aa1d-9c525f725dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:17.336036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b981f-8882-41cb-aa1d-9c525f725dda None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.336459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b981f-8882-41cb-aa1d-9c525f725dda None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.336930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b981f-8882-41cb-aa1d-9c525f725dda None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.338456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b981f-8882-41cb-aa1d-9c525f725dda None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:17.340151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b981f-8882-41cb-aa1d-9c525f725dda None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:17.350661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 212/425] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:16 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:17.355661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b981f-8882-41cb-aa1d-9c525f725dda None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:17.372096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:17.418743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45410e21-ebf0-4180-8fd9-353e08d33fec None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:17.458660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a38ee-c3aa-4feb-942f-d15512e43529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:17.459757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a38ee-c3aa-4feb-942f-d15512e43529 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.460138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a38ee-c3aa-4feb-942f-d15512e43529 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.460510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a38ee-c3aa-4feb-942f-d15512e43529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.530229 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:17.536595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a38ee-c3aa-4feb-942f-d15512e43529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:17.538734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a38ee-c3aa-4feb-942f-d15512e43529 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:17.612994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:17.623745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b981f-8882-41cb-aa1d-9c525f725dda None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:17.648352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 214/426] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:17.653360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a38ee-c3aa-4feb-942f-d15512e43529 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:17.690896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2787b-5494-420c-bc2c-f76a4ee95470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:17.691758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2787b-5494-420c-bc2c-f76a4ee95470 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.692040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2787b-5494-420c-bc2c-f76a4ee95470 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.692316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2787b-5494-420c-bc2c-f76a4ee95470 None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.695068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2787b-5494-420c-bc2c-f76a4ee95470 None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:17.696550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2787b-5494-420c-bc2c-f76a4ee95470 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:17.699001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 213/427] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:17 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:17.705514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2787b-5494-420c-bc2c-f76a4ee95470 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:17.820466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a38ee-c3aa-4feb-942f-d15512e43529 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:17.855039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2787b-5494-420c-bc2c-f76a4ee95470 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:17.862412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d3428-b631-45ca-b1c6-ddbf62097ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:17.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d3428-b631-45ca-b1c6-ddbf62097ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.863577 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d3428-b631-45ca-b1c6-ddbf62097ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.864276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d3428-b631-45ca-b1c6-ddbf62097ec8 None admin] PATH_INFO: `/v3/projects/9f140c317e2e4605b3c3ef8420147900` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.866101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d3428-b631-45ca-b1c6-ddbf62097ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=9f140c317e2e4605b3c3ef8420147900)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:17.868262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d3428-b631-45ca-b1c6-ddbf62097ec8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:17.872287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 215/428] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:17 2022] GET /identity/v3/projects/9f140c317e2e4605b3c3ef8420147900 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:17.873675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f31c36-8963-497e-9c64-9d04afae5d58 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.873970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f31c36-8963-497e-9c64-9d04afae5d58 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.874250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f31c36-8963-497e-9c64-9d04afae5d58 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.875487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 216/429] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:17.877398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f31c36-8963-497e-9c64-9d04afae5d58 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:17.899790 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:17.909174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa613-343c-4b5a-988a-89f5ab54a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:17.910228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa613-343c-4b5a-988a-89f5ab54a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.910680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa613-343c-4b5a-988a-89f5ab54a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.910795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:17.912462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa613-343c-4b5a-988a-89f5ab54a5e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.914125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa613-343c-4b5a-988a-89f5ab54a5e8 None admin] RBAC: Adding query filter params (group.id=5f81809573144288909840fa605d3c61, role.id=f5a5bdf6fee0438391dd54c5b545305e, scope.project.id=9f140c317e2e4605b3c3ef8420147900) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:17.914616 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa613-343c-4b5a-988a-89f5ab54a5e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:17.916985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa613-343c-4b5a-988a-89f5ab54a5e8 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:17.932840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 214/430] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jun 20 06:00:17 2022] GET /identity/v3/role_assignments?group.id=5f81809573144288909840fa605d3c61&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:17.934467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566f6d-3fa8-4f45-91bb-8ac9b9ac8ebf None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.934768 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566f6d-3fa8-4f45-91bb-8ac9b9ac8ebf None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.935082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566f6d-3fa8-4f45-91bb-8ac9b9ac8ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.967920 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e3566f6d-3fa8-4f45-91bb-8ac9b9ac8ebf None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:17.969284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e3566f6d-3fa8-4f45-91bb-8ac9b9ac8ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:17.998607 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f31c36-8963-497e-9c64-9d04afae5d58 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:18.038042 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35a1e0-cdc8-4ca6-b9eb-ea009a2b994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:18.039191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35a1e0-cdc8-4ca6-b9eb-ea009a2b994c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:18.039879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35a1e0-cdc8-4ca6-b9eb-ea009a2b994c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:18.040347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35a1e0-cdc8-4ca6-b9eb-ea009a2b994c None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:18.041836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35a1e0-cdc8-4ca6-b9eb-ea009a2b994c None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:18.045443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35a1e0-cdc8-4ca6-b9eb-ea009a2b994c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:18.047853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 217/431] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:17 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:18.058943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35a1e0-cdc8-4ca6-b9eb-ea009a2b994c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:18.126287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 215/432] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:18.170463 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:18.180596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3566f6d-3fa8-4f45-91bb-8ac9b9ac8ebf None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:18.187633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35a1e0-cdc8-4ca6-b9eb-ea009a2b994c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:18.235075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4306ba-c232-4f45-ba46-419fa24f030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:18.235747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4306ba-c232-4f45-ba46-419fa24f030d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:18.236089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4306ba-c232-4f45-ba46-419fa24f030d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:18.236376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4306ba-c232-4f45-ba46-419fa24f030d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:18.237342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4306ba-c232-4f45-ba46-419fa24f030d None admin] RBAC: Adding query filter params (group.id=5f81809573144288909840fa605d3c61, role.id=0af0bb9954e74b6c9158c0ea76a2c7a5, scope.project.id=9f140c317e2e4605b3c3ef8420147900) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:18.237669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4306ba-c232-4f45-ba46-419fa24f030d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:18.239218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4306ba-c232-4f45-ba46-419fa24f030d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:18.246738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 218/433] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jun 20 06:00:18 2022] GET /identity/v3/role_assignments?group.id=5f81809573144288909840fa605d3c61&scope.project.id=9f140c317e2e4605b3c3ef8420147900&role.id=0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:18.274866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d64e7e-cc45-4ea9-8de4-53f252b2a54d None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:18.275499 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d64e7e-cc45-4ea9-8de4-53f252b2a54d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:18.275846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d64e7e-cc45-4ea9-8de4-53f252b2a54d None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:18.283071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 219/434] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:18.293049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727ffa-9b52-49aa-aa5d-b4358a720e4c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:18.293663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727ffa-9b52-49aa-aa5d-b4358a720e4c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:18.293748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727ffa-9b52-49aa-aa5d-b4358a720e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:18.316781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3e727ffa-9b52-49aa-aa5d-b4358a720e4c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:18.318663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3e727ffa-9b52-49aa-aa5d-b4358a720e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:18.324303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3566f6d-3fa8-4f45-91bb-8ac9b9ac8ebf None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:18.354338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:18.374581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea69a33-d899-4b12-b5ee-5913fb49f7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:18.375467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea69a33-d899-4b12-b5ee-5913fb49f7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:18.375793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea69a33-d899-4b12-b5ee-5913fb49f7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:18.376077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea69a33-d899-4b12-b5ee-5913fb49f7f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:18.399861 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea69a33-d899-4b12-b5ee-5913fb49f7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:18.404241 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 220/435] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-9ea69a33-d899-4b12-b5ee-5913fb49f7f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:18.409447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:18.410379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 06:00:18.411218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:18.414621 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 216/436] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:18.420551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e727ffa-9b52-49aa-aa5d-b4358a720e4c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:18.433830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea69a33-d899-4b12-b5ee-5913fb49f7f6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:18.535062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:18.545564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e727ffa-9b52-49aa-aa5d-b4358a720e4c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:18.563782 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea69a33-d899-4b12-b5ee-5913fb49f7f6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:18.593221 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e5b5b-9a16-424c-8924-45f4998c26c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:18.594056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e5b5b-9a16-424c-8924-45f4998c26c9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:18.594349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e5b5b-9a16-424c-8924-45f4998c26c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:18.594636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e5b5b-9a16-424c-8924-45f4998c26c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:18.595420 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e5b5b-9a16-424c-8924-45f4998c26c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:18.595708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e5b5b-9a16-424c-8924-45f4998c26c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:18.598173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e5b5b-9a16-424c-8924-45f4998c26c9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:18.606413 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 221/437] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:00:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:18.607346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8bca4-6c1d-4c43-8582-1bf7f7f05d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:18.607570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9c50a-8e73-4e53-8ecb-f370280dc082 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:18.607822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9c50a-8e73-4e53-8ecb-f370280dc082 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:18.608103 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9c50a-8e73-4e53-8ecb-f370280dc082 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:18.608203 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8bca4-6c1d-4c43-8582-1bf7f7f05d41 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:18.608428 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8bca4-6c1d-4c43-8582-1bf7f7f05d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:18.608746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8bca4-6c1d-4c43-8582-1bf7f7f05d41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:18.609622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 222/438] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:18.615303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dba33b-58ac-4d92-8dc5-b74d6d04d038 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:18.615724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dba33b-58ac-4d92-8dc5-b74d6d04d038 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:18.616013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dba33b-58ac-4d92-8dc5-b74d6d04d038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:18.626221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8bca4-6c1d-4c43-8582-1bf7f7f05d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:18.633640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-29dba33b-58ac-4d92-8dc5-b74d6d04d038 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:18.634704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-29dba33b-58ac-4d92-8dc5-b74d6d04d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-30b8bca4-6c1d-4c43-8582-1bf7f7f05d41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:18.635265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:18.636111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 217/439] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:00:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:18.637776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8bca4-6c1d-4c43-8582-1bf7f7f05d41 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:18.695971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:18.719614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 223/440] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:18.720377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dba33b-58ac-4d92-8dc5-b74d6d04d038 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:18.763603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8bca4-6c1d-4c43-8582-1bf7f7f05d41 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:18.805754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526dfeb-9c4a-401d-a13d-fd11467135a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:18.806414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526dfeb-9c4a-401d-a13d-fd11467135a6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:18.806710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526dfeb-9c4a-401d-a13d-fd11467135a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:18.806996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526dfeb-9c4a-401d-a13d-fd11467135a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:18.825188 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:18.844439 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dba33b-58ac-4d92-8dc5-b74d6d04d038 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:18.876311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526dfeb-9c4a-401d-a13d-fd11467135a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:18.877821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526dfeb-9c4a-401d-a13d-fd11467135a6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:18.878961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5fb66-81b0-42b4-8b73-ca487b96a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:18.879628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fb66-81b0-42b4-8b73-ca487b96a84f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:18.879912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fb66-81b0-42b4-8b73-ca487b96a84f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:18.880187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fb66-81b0-42b4-8b73-ca487b96a84f None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:18.880969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5fb66-81b0-42b4-8b73-ca487b96a84f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:18.881273 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5fb66-81b0-42b4-8b73-ca487b96a84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:18.882630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5fb66-81b0-42b4-8b73-ca487b96a84f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:18.890538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 224/441] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:18.891229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5fb66-81b0-42b4-8b73-ca487b96a84f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:18.927217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:18.982000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 218/442] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:18.982791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526dfeb-9c4a-401d-a13d-fd11467135a6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:18.991818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5fb66-81b0-42b4-8b73-ca487b96a84f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.025819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadbd3b-384c-4948-8ddf-3116941c262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.026608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadbd3b-384c-4948-8ddf-3116941c262a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.026892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadbd3b-384c-4948-8ddf-3116941c262a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.027174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadbd3b-384c-4948-8ddf-3116941c262a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.038522 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadbd3b-384c-4948-8ddf-3116941c262a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-9eadbd3b-384c-4948-8ddf-3116941c262a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:19.046176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:19.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:19.047988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 225/443] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:19.048685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadbd3b-384c-4948-8ddf-3116941c262a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:19.052884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:19.089819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526dfeb-9c4a-401d-a13d-fd11467135a6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.123223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4570bf-06ca-4115-9a46-bcd7a3793d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.123867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4570bf-06ca-4115-9a46-bcd7a3793d17 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.124153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4570bf-06ca-4115-9a46-bcd7a3793d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.124426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4570bf-06ca-4115-9a46-bcd7a3793d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.138964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:19.149723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadbd3b-384c-4948-8ddf-3116941c262a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.184217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3894fe7-b0e0-4e01-8737-8cff29d0910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.185118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3894fe7-b0e0-4e01-8737-8cff29d0910f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.185425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3894fe7-b0e0-4e01-8737-8cff29d0910f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.185690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3894fe7-b0e0-4e01-8737-8cff29d0910f None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.186937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3894fe7-b0e0-4e01-8737-8cff29d0910f None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:19.188387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3894fe7-b0e0-4e01-8737-8cff29d0910f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:19.190123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 226/444] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:19 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:19.190892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3894fe7-b0e0-4e01-8737-8cff29d0910f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:19.199244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4570bf-06ca-4115-9a46-bcd7a3793d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:19.200764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4570bf-06ca-4115-9a46-bcd7a3793d17 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:19.265138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:19.295324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3894fe7-b0e0-4e01-8737-8cff29d0910f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.306334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 219/445] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:19.306334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4570bf-06ca-4115-9a46-bcd7a3793d17 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:19.330161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa44ca9-5ea4-4a6d-a617-d50934c27051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.330841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa44ca9-5ea4-4a6d-a617-d50934c27051 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.331131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa44ca9-5ea4-4a6d-a617-d50934c27051 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.331418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa44ca9-5ea4-4a6d-a617-d50934c27051 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.332166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa44ca9-5ea4-4a6d-a617-d50934c27051 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:19.332480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa44ca9-5ea4-4a6d-a617-d50934c27051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:19.334518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa44ca9-5ea4-4a6d-a617-d50934c27051 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:19.343227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 227/446] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:19.343227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa44ca9-5ea4-4a6d-a617-d50934c27051 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:19.350795 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:19.406085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4570bf-06ca-4115-9a46-bcd7a3793d17 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.439349 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb5df8-6562-4401-a140-d370517f496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.440276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb5df8-6562-4401-a140-d370517f496e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.440571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb5df8-6562-4401-a140-d370517f496e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.440879 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb5df8-6562-4401-a140-d370517f496e None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.442054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb5df8-6562-4401-a140-d370517f496e None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:19.444088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb5df8-6562-4401-a140-d370517f496e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:19.445160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa44ca9-5ea4-4a6d-a617-d50934c27051 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.445744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 220/447] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:19 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:19.446512 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb5df8-6562-4401-a140-d370517f496e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:19.480540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e45c7-9e4a-4c95-888f-765d44119c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.481422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e45c7-9e4a-4c95-888f-765d44119c0e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.481705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e45c7-9e4a-4c95-888f-765d44119c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.481975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e45c7-9e4a-4c95-888f-765d44119c0e None admin] PATH_INFO: `/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.483223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e45c7-9e4a-4c95-888f-765d44119c0e None admin] RBAC: Authorizing `identity:get_project(project_id=8502c12b7f0541c4bdb1cf6fb8092f4a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:19.484825 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e45c7-9e4a-4c95-888f-765d44119c0e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:19.486529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 228/448] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:19 2022] GET /identity/v3/projects/8502c12b7f0541c4bdb1cf6fb8092f4a => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:19.487292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e45c7-9e4a-4c95-888f-765d44119c0e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:19.490253 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:19.550982 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb5df8-6562-4401-a140-d370517f496e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.564317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:19.586407 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fd521-1a98-4a8f-ad0e-ff107e15e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.587060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fd521-1a98-4a8f-ad0e-ff107e15e359 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.587348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fd521-1a98-4a8f-ad0e-ff107e15e359 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.587630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fd521-1a98-4a8f-ad0e-ff107e15e359 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.590101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e45c7-9e4a-4c95-888f-765d44119c0e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.623086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da80b8-c23b-4ad5-b013-b9fc82f02382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.623742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da80b8-c23b-4ad5-b013-b9fc82f02382 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.624027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da80b8-c23b-4ad5-b013-b9fc82f02382 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.624304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da80b8-c23b-4ad5-b013-b9fc82f02382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.625164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da80b8-c23b-4ad5-b013-b9fc82f02382 None admin] RBAC: Adding query filter params (group.id=5f81809573144288909840fa605d3c61, role.id=f5a5bdf6fee0438391dd54c5b545305e, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:19.625476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da80b8-c23b-4ad5-b013-b9fc82f02382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:19.626913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da80b8-c23b-4ad5-b013-b9fc82f02382 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:19.633170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 229/449] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jun 20 06:00:19 2022] GET /identity/v3/role_assignments?group.id=5f81809573144288909840fa605d3c61&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=f5a5bdf6fee0438391dd54c5b545305e => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:19.633780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da80b8-c23b-4ad5-b013-b9fc82f02382 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:19.667693 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fd521-1a98-4a8f-ad0e-ff107e15e359 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:19.669275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fd521-1a98-4a8f-ad0e-ff107e15e359 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:19.707451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:19.747466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da80b8-c23b-4ad5-b013-b9fc82f02382 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.787356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df255f60-5daa-42e5-a277-aa4e1d1dda4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.788030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df255f60-5daa-42e5-a277-aa4e1d1dda4b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.788319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df255f60-5daa-42e5-a277-aa4e1d1dda4b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.788598 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df255f60-5daa-42e5-a277-aa4e1d1dda4b None admin] PATH_INFO: `/v3/groups/5f81809573144288909840fa605d3c61` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.789830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df255f60-5daa-42e5-a277-aa4e1d1dda4b None admin] RBAC: Authorizing `identity:get_group(group_id=5f81809573144288909840fa605d3c61)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:19.791286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df255f60-5daa-42e5-a277-aa4e1d1dda4b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:19.792137 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 221/450] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:19.798521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 230/451] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:19 2022] GET /identity/v3/groups/5f81809573144288909840fa605d3c61 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:19.798648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fd521-1a98-4a8f-ad0e-ff107e15e359 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:19.799315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df255f60-5daa-42e5-a277-aa4e1d1dda4b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:19.813969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:19.922411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df255f60-5daa-42e5-a277-aa4e1d1dda4b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.929725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fd521-1a98-4a8f-ad0e-ff107e15e359 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.965839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e96f28-0a7e-44b1-8ce0-c7e99333f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.966505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e96f28-0a7e-44b1-8ce0-c7e99333f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.966939 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e96f28-0a7e-44b1-8ce0-c7e99333f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.967223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e96f28-0a7e-44b1-8ce0-c7e99333f2d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.968059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e96f28-0a7e-44b1-8ce0-c7e99333f2d5 None admin] RBAC: Adding query filter params (group.id=5f81809573144288909840fa605d3c61, role.id=0af0bb9954e74b6c9158c0ea76a2c7a5, scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:19.968377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e96f28-0a7e-44b1-8ce0-c7e99333f2d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:19.969957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e96f28-0a7e-44b1-8ce0-c7e99333f2d5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:19.972084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:19.973086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912d2a4-343b-40e1-a79b-c4ae3a08fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.974819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d2a4-343b-40e1-a79b-c4ae3a08fea7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.975176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d2a4-343b-40e1-a79b-c4ae3a08fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.975463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d2a4-343b-40e1-a79b-c4ae3a08fea7 None admin] PATH_INFO: `/v3/projects/bc8cc051ad1a43a898b15611374a54c1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.976769 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912d2a4-343b-40e1-a79b-c4ae3a08fea7 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8cc051ad1a43a898b15611374a54c1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:19.978259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912d2a4-343b-40e1-a79b-c4ae3a08fea7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:19.980273 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 222/453] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:00:19 2022] GET /identity/v3/projects/bc8cc051ad1a43a898b15611374a54c1 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:19.980818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 231/453] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jun 20 06:00:19 2022] GET /identity/v3/role_assignments?group.id=5f81809573144288909840fa605d3c61&scope.project.id=8502c12b7f0541c4bdb1cf6fb8092f4a&role.id=0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:19.985939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912d2a4-343b-40e1-a79b-c4ae3a08fea7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:20.075435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:20.096346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912d2a4-343b-40e1-a79b-c4ae3a08fea7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:20.132917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616128a6-cba2-44dd-adae-2d701cad4160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:20.133777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616128a6-cba2-44dd-adae-2d701cad4160 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:20.134056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616128a6-cba2-44dd-adae-2d701cad4160 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:20.134324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616128a6-cba2-44dd-adae-2d701cad4160 None admin] PATH_INFO: `/v3/groups/83f889fd51a54a08b6d61aff3835d901` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:20.135499 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616128a6-cba2-44dd-adae-2d701cad4160 None admin] RBAC: Authorizing `identity:get_group(group_id=83f889fd51a54a08b6d61aff3835d901)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:20.136973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616128a6-cba2-44dd-adae-2d701cad4160 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:20.138580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 223/454] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jun 20 06:00:19 2022] GET /identity/v3/groups/83f889fd51a54a08b6d61aff3835d901 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:20.144396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e96f28-0a7e-44b1-8ce0-c7e99333f2d5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:20.248004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e96f28-0a7e-44b1-8ce0-c7e99333f2d5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:20.280970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048571a-f002-4172-b879-57994e136a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:20.281635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048571a-f002-4172-b879-57994e136a5b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:20.281922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048571a-f002-4172-b879-57994e136a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:20.282204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048571a-f002-4172-b879-57994e136a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:20.283052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048571a-f002-4172-b879-57994e136a5b None admin] RBAC: Adding query filter params (group.id=83f889fd51a54a08b6d61aff3835d901, role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=bc8cc051ad1a43a898b15611374a54c1) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:20.283372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048571a-f002-4172-b879-57994e136a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:20.285117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048571a-f002-4172-b879-57994e136a5b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:20.291719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 232/455] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jun 20 06:00:20 2022] GET /identity/v3/role_assignments?group.id=83f889fd51a54a08b6d61aff3835d901&scope.project.id=bc8cc051ad1a43a898b15611374a54c1&role.id=efc16976111d431c9173186cbd0e6c24 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:22.716382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac1bd-5647-40ad-9bdd-4cbf0b16fb3b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:22.716918 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac1bd-5647-40ad-9bdd-4cbf0b16fb3b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:22.716993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fac1bd-5647-40ad-9bdd-4cbf0b16fb3b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:22.718624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 224/456] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:22.723651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4165235-1c60-4b48-a31b-24ea363f1250 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:22.724779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4165235-1c60-4b48-a31b-24ea363f1250 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:22.725275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4165235-1c60-4b48-a31b-24ea363f1250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:22.749989 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b4165235-1c60-4b48-a31b-24ea363f1250 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:22.751509 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b4165235-1c60-4b48-a31b-24ea363f1250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:22.832263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:22.844740 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 233/457] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:22.886224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fac1bd-5647-40ad-9bdd-4cbf0b16fb3b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:22.897558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2bbc-0211-485b-8132-160bc26a35db None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:22.897860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2bbc-0211-485b-8132-160bc26a35db None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:22.898142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2bbc-0211-485b-8132-160bc26a35db None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:22.899796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 234/458] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:22.904473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201251a-2268-41d3-88bc-675920ea8635 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:22.905037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201251a-2268-41d3-88bc-675920ea8635 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:22.905525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201251a-2268-41d3-88bc-675920ea8635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:22.933673 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7201251a-2268-41d3-88bc-675920ea8635 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:22.934866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7201251a-2268-41d3-88bc-675920ea8635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:23.028714 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 235/459] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:23.050532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201251a-2268-41d3-88bc-675920ea8635 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:23.064534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fac1bd-5647-40ad-9bdd-4cbf0b16fb3b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:23.121861 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8537f7f-3b1a-4341-98a3-46f55eb87f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:23.123860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8537f7f-3b1a-4341-98a3-46f55eb87f5b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.124322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8537f7f-3b1a-4341-98a3-46f55eb87f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.124796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8537f7f-3b1a-4341-98a3-46f55eb87f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.138663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8537f7f-3b1a-4341-98a3-46f55eb87f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:23.141139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8537f7f-3b1a-4341-98a3-46f55eb87f5b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:23.153688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-e8537f7f-3b1a-4341-98a3-46f55eb87f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:23.168389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:23.169310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:23.170235 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:23.170235 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:23.170235 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:23.170235 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:23.178557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 225/460] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:23.178886 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e86b-100b-4138-b3a8-f65e000e0a66 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.179363 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e86b-100b-4138-b3a8-f65e000e0a66 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.179468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e86b-100b-4138-b3a8-f65e000e0a66 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.180789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 226/461] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:23.185525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3e86b-100b-4138-b3a8-f65e000e0a66 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:23.191840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201251a-2268-41d3-88bc-675920ea8635 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:23.218263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:23.231430 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a20fa3-99a7-4faf-b153-fb3e7ccdf30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:23.232346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20fa3-99a7-4faf-b153-fb3e7ccdf30c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.232748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20fa3-99a7-4faf-b153-fb3e7ccdf30c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.233092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20fa3-99a7-4faf-b153-fb3e7ccdf30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.245463 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a20fa3-99a7-4faf-b153-fb3e7ccdf30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:23.247214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a20fa3-99a7-4faf-b153-fb3e7ccdf30c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-16a20fa3-99a7-4faf-b153-fb3e7ccdf30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:23.266654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:23.267563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:23.268394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:23.268394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:23.268394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:23.268394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:23.275713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 236/462] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:23.277342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88698a93-7a9d-4213-b83a-fe2e60e44b94 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.277826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88698a93-7a9d-4213-b83a-fe2e60e44b94 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.278293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88698a93-7a9d-4213-b83a-fe2e60e44b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.299285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-88698a93-7a9d-4213-b83a-fe2e60e44b94 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:23.301031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-88698a93-7a9d-4213-b83a-fe2e60e44b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:23.301243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3e86b-100b-4138-b3a8-f65e000e0a66 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:23.340026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16ad26-ad33-4c57-a532-edb08729991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:23.340723 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16ad26-ad33-4c57-a532-edb08729991e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.341015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16ad26-ad33-4c57-a532-edb08729991e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.341298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16ad26-ad33-4c57-a532-edb08729991e None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.342041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16ad26-ad33-4c57-a532-edb08729991e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:23.342356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16ad26-ad33-4c57-a532-edb08729991e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:23.343955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16ad26-ad33-4c57-a532-edb08729991e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:23.358389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 227/463] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:23.359612 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16ad26-ad33-4c57-a532-edb08729991e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:23.386512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 237/464] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:23.387683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88698a93-7a9d-4213-b83a-fe2e60e44b94 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:23.454676 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:23.501761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16ad26-ad33-4c57-a532-edb08729991e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:23.508932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88698a93-7a9d-4213-b83a-fe2e60e44b94 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:23.511687 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:23.542248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e253982-6180-472a-a74b-8f5ed145d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:23.543339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253982-6180-472a-a74b-8f5ed145d21c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.543830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253982-6180-472a-a74b-8f5ed145d21c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.544326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253982-6180-472a-a74b-8f5ed145d21c None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.545282 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e253982-6180-472a-a74b-8f5ed145d21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:23.545814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e253982-6180-472a-a74b-8f5ed145d21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:23.547399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c0a5b-f708-4221-a8f5-4bc93416c251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:23.547696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e253982-6180-472a-a74b-8f5ed145d21c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:23.548072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c0a5b-f708-4221-a8f5-4bc93416c251 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.548353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c0a5b-f708-4221-a8f5-4bc93416c251 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.548649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c0a5b-f708-4221-a8f5-4bc93416c251 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.549354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c0a5b-f708-4221-a8f5-4bc93416c251 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:23.550956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c0a5b-f708-4221-a8f5-4bc93416c251 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:23.562218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 228/465] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:23.563524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e253982-6180-472a-a74b-8f5ed145d21c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:23.574191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 238/466] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 06:00:23 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:00:23.575567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe358c-0bfd-412d-9e68-96fcb253f9f5 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.575973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe358c-0bfd-412d-9e68-96fcb253f9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.576352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe358c-0bfd-412d-9e68-96fcb253f9f5 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.578060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 239/467] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:23.578782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe358c-0bfd-412d-9e68-96fcb253f9f5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:23.705587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e253982-6180-472a-a74b-8f5ed145d21c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:23.725370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe358c-0bfd-412d-9e68-96fcb253f9f5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:23.731804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:23.750998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b88e6d-39dc-46cb-900c-e06f859bacc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:23.751798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b88e6d-39dc-46cb-900c-e06f859bacc1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.752085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b88e6d-39dc-46cb-900c-e06f859bacc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.752360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b88e6d-39dc-46cb-900c-e06f859bacc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.765292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b88e6d-39dc-46cb-900c-e06f859bacc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:23.767023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b88e6d-39dc-46cb-900c-e06f859bacc1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:23.771636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc7bd-df1c-493b-b966-545b7a957dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:23.772319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc7bd-df1c-493b-b966-545b7a957dbb None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.772634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc7bd-df1c-493b-b966-545b7a957dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.772915 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc7bd-df1c-493b-b966-545b7a957dbb None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.773633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cc7bd-df1c-493b-b966-545b7a957dbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:23.775083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cc7bd-df1c-493b-b966-545b7a957dbb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-46b88e6d-39dc-46cb-900c-e06f859bacc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:23.788702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:23.789630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:23.790498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:23.790498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:23.790498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:23.790498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:23.790498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 229/468] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:23.795714 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d34b30-f4b4-4c40-b8db-77de55f82762 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.795714 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d34b30-f4b4-4c40-b8db-77de55f82762 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.795714 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d34b30-f4b4-4c40-b8db-77de55f82762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.804454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 240/469] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 06:00:23 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:00:23.809552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc7bd-df1c-493b-b966-545b7a957dbb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:23.815482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-91d34b30-f4b4-4c40-b8db-77de55f82762 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:23.817027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-91d34b30-f4b4-4c40-b8db-77de55f82762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:23.832645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:23.908510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 230/470] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:23.938815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc7bd-df1c-493b-b966-545b7a957dbb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:23.941821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d34b30-f4b4-4c40-b8db-77de55f82762 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:23.988305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ea0ec-85e5-47ec-b1ce-7457e89b7a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:23.989339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ea0ec-85e5-47ec-b1ce-7457e89b7a91 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:23.990423 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ea0ec-85e5-47ec-b1ce-7457e89b7a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:23.990884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ea0ec-85e5-47ec-b1ce-7457e89b7a91 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:23.991817 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ea0ec-85e5-47ec-b1ce-7457e89b7a91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:23.992362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ea0ec-85e5-47ec-b1ce-7457e89b7a91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:23.993960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ea0ec-85e5-47ec-b1ce-7457e89b7a91 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:24.013570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 241/471] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:24.019181 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ea0ec-85e5-47ec-b1ce-7457e89b7a91 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:24.072275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d34b30-f4b4-4c40-b8db-77de55f82762 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:24.074051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:24.103897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:24.116286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f268f3-84be-46a6-a673-71920cff21b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:24.116854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f268f3-84be-46a6-a673-71920cff21b2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:24.117137 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f268f3-84be-46a6-a673-71920cff21b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:24.117413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f268f3-84be-46a6-a673-71920cff21b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:24.129385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ea0ec-85e5-47ec-b1ce-7457e89b7a91 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:24.131215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f268f3-84be-46a6-a673-71920cff21b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:24.132865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f268f3-84be-46a6-a673-71920cff21b2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-16f268f3-84be-46a6-a673-71920cff21b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:24.152554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:24.153489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:24.154433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:24.154433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:24.154433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:24.154433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:24.157558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 231/472] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:24.161077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f268f3-84be-46a6-a673-71920cff21b2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:24.170512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec5b02-a308-4116-a6e4-7606590476fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:24.171533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec5b02-a308-4116-a6e4-7606590476fd None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:24.172023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec5b02-a308-4116-a6e4-7606590476fd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:24.172504 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec5b02-a308-4116-a6e4-7606590476fd None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:24.173441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec5b02-a308-4116-a6e4-7606590476fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:24.175095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec5b02-a308-4116-a6e4-7606590476fd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:24.199677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 242/473] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 06:00:24 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:00:24.286548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f268f3-84be-46a6-a673-71920cff21b2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:24.331687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530692a7-4a05-46ff-8106-3cfe9783f610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:24.332372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530692a7-4a05-46ff-8106-3cfe9783f610 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:24.332686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530692a7-4a05-46ff-8106-3cfe9783f610 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:24.332969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530692a7-4a05-46ff-8106-3cfe9783f610 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:24.334155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530692a7-4a05-46ff-8106-3cfe9783f610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:24.334480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530692a7-4a05-46ff-8106-3cfe9783f610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:24.335919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530692a7-4a05-46ff-8106-3cfe9783f610 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:24.343827 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f891b-55be-43ee-aa36-acb3f849d0cf None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:24.344493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f891b-55be-43ee-aa36-acb3f849d0cf None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:24.344810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f891b-55be-43ee-aa36-acb3f849d0cf None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:24.346448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 243/474] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:24.352970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 232/475] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:24.354241 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89ad48-5559-481f-a518-39b7794e705f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:24.354573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89ad48-5559-481f-a518-39b7794e705f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:24.354876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89ad48-5559-481f-a518-39b7794e705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:24.356485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530692a7-4a05-46ff-8106-3cfe9783f610 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:24.381932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:24.387303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9d89ad48-5559-481f-a518-39b7794e705f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:24.388587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9d89ad48-5559-481f-a518-39b7794e705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:24.471897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 244/476] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:24.490500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530692a7-4a05-46ff-8106-3cfe9783f610 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:24.497667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89ad48-5559-481f-a518-39b7794e705f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:24.530282 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dba16b-e42d-4298-86d9-49d598eb0a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:24.530960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dba16b-e42d-4298-86d9-49d598eb0a8f None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:24.531395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dba16b-e42d-4298-86d9-49d598eb0a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:24.531681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dba16b-e42d-4298-86d9-49d598eb0a8f None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:24.532397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dba16b-e42d-4298-86d9-49d598eb0a8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:24.534557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dba16b-e42d-4298-86d9-49d598eb0a8f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:24.564874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 233/477] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 06:00:24 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:00:24.585066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:24.651184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89ad48-5559-481f-a518-39b7794e705f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:24.701238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801d517-8290-47f0-b5d4-003a53a2cc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:24.701944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801d517-8290-47f0-b5d4-003a53a2cc8e None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:24.702233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801d517-8290-47f0-b5d4-003a53a2cc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:24.702513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801d517-8290-47f0-b5d4-003a53a2cc8e None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:24.703363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801d517-8290-47f0-b5d4-003a53a2cc8e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:24.704874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801d517-8290-47f0-b5d4-003a53a2cc8e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:24.713930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.sql.core [None req-9801d517-8290-47f0-b5d4-003a53a2cc8e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 06:00:24.713930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 06:00:24.713930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [parameters: {'id': '21fbe668fd98498a8d9faa56fd553a2f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 06:00:24.713930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80270) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-9801d517-8290-47f0-b5d4-003a53a2cc8e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application conn.query(q) Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application result.read() Jun 20 06:00:24.732070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return ref.to_dict() Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 06:00:24.733462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application next(self.gen) Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application yield resource Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application next(self.gen) Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise self.value Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application session.commit() Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 06:00:24.734387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.session.flush() Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application compat.raise_( Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 06:00:24.735242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 06:00:24.736128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application conn.query(q) Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application result.read() Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 06:00:24.738118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [parameters: {'id': '21fbe668fd98498a8d9faa56fd553a2f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:24.740898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 06:00:24.742872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:24.744510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 245/478] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jun 20 06:00:24 2022] POST /identity/v3/roles => generated 144 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:24.750505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dba16b-e42d-4298-86d9-49d598eb0a8f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:24.826446 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:24.859680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dba16b-e42d-4298-86d9-49d598eb0a8f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:24.894184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b6f15-b010-4797-a63b-536deecc754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:24.895008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b6f15-b010-4797-a63b-536deecc754f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:24.895300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b6f15-b010-4797-a63b-536deecc754f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:24.896102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b6f15-b010-4797-a63b-536deecc754f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:24.907969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b6f15-b010-4797-a63b-536deecc754f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f97b6f15-b010-4797-a63b-536deecc754f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:24.916684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:24.917591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:24.918463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 234/479] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:00:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:24.923550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801d517-8290-47f0-b5d4-003a53a2cc8e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:25.033624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801d517-8290-47f0-b5d4-003a53a2cc8e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:25.063737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:25.075927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793abf-d4ac-41f4-ac27-173d09797d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:25.077218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793abf-d4ac-41f4-ac27-173d09797d22 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:25.077888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793abf-d4ac-41f4-ac27-173d09797d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:25.078504 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793abf-d4ac-41f4-ac27-173d09797d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:25.079293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79793abf-d4ac-41f4-ac27-173d09797d22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:25.080010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79793abf-d4ac-41f4-ac27-173d09797d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:25.081490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79793abf-d4ac-41f4-ac27-173d09797d22 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:25.091282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 246/480] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:26.148411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387b8c1-4b65-4712-982c-4fa2e46f3117 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:26.148991 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387b8c1-4b65-4712-982c-4fa2e46f3117 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:26.148991 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387b8c1-4b65-4712-982c-4fa2e46f3117 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:26.150504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 235/481] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:26.155743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ba493-6567-4e31-a287-49beae3614bd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:26.156127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ba493-6567-4e31-a287-49beae3614bd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:26.156318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ba493-6567-4e31-a287-49beae3614bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:26.181592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-457ba493-6567-4e31-a287-49beae3614bd None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:26.182798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-457ba493-6567-4e31-a287-49beae3614bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:26.272055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 247/482] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:26.308517 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387b8c1-4b65-4712-982c-4fa2e46f3117 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:26.465965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387b8c1-4b65-4712-982c-4fa2e46f3117 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:26.504999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:26.513888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f0e1b-e940-4518-99ae-4fc7ec57b8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:26.514698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0e1b-e940-4518-99ae-4fc7ec57b8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:26.514988 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0e1b-e940-4518-99ae-4fc7ec57b8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:26.515269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0e1b-e940-4518-99ae-4fc7ec57b8b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:26.529054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f0e1b-e940-4518-99ae-4fc7ec57b8b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-877f0e1b-e940-4518-99ae-4fc7ec57b8b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:26.537460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:26.538359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:26.539161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 236/483] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:26.549722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ba493-6567-4e31-a287-49beae3614bd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:26.597890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29044baf-901c-4586-84fa-f1cc00f18460 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:26.598209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29044baf-901c-4586-84fa-f1cc00f18460 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:26.598456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29044baf-901c-4586-84fa-f1cc00f18460 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:26.600417 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 237/484] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:00:26.607820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998096d-29ef-47f4-b87c-504166f51c69 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:26.608488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998096d-29ef-47f4-b87c-504166f51c69 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:26.608962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998096d-29ef-47f4-b87c-504166f51c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:26.642463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8998096d-29ef-47f4-b87c-504166f51c69 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:26.643836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8998096d-29ef-47f4-b87c-504166f51c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:26.725099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 238/485] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:26.750407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ba493-6567-4e31-a287-49beae3614bd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:26.760112 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998096d-29ef-47f4-b87c-504166f51c69 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:26.798100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:26.866309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9e676-f951-4363-a0e1-a0ec2f539c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:26.866784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e676-f951-4363-a0e1-a0ec2f539c6e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:26.867079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e676-f951-4363-a0e1-a0ec2f539c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:26.867363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e676-f951-4363-a0e1-a0ec2f539c6e None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:26.868119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9e676-f951-4363-a0e1-a0ec2f539c6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:26.868428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9e676-f951-4363-a0e1-a0ec2f539c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:26.869884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9e676-f951-4363-a0e1-a0ec2f539c6e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:26.876801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998096d-29ef-47f4-b87c-504166f51c69 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:26.895115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 248/486] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:26.901272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9e676-f951-4363-a0e1-a0ec2f539c6e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:26.902975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:26.919928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a154c-ec62-4b19-ad65-6fbb4cbeb2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:26.921854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a154c-ec62-4b19-ad65-6fbb4cbeb2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:26.922354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a154c-ec62-4b19-ad65-6fbb4cbeb2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:26.922884 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a154c-ec62-4b19-ad65-6fbb4cbeb2e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:26.936745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a154c-ec62-4b19-ad65-6fbb4cbeb2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-404a154c-ec62-4b19-ad65-6fbb4cbeb2e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:26.946334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:26.947244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:26.948073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:26.951195 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 239/487] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:26.956501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a154c-ec62-4b19-ad65-6fbb4cbeb2e2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:27.073500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9e676-f951-4363-a0e1-a0ec2f539c6e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:27.082088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a154c-ec62-4b19-ad65-6fbb4cbeb2e2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:27.117309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40913e-46cc-4dbe-b977-8f7781471ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:27.118649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40913e-46cc-4dbe-b977-8f7781471ddc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.119489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40913e-46cc-4dbe-b977-8f7781471ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.120249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40913e-46cc-4dbe-b977-8f7781471ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.125319 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bc280-0a18-429b-be43-9c91a230f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:27.126097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bc280-0a18-429b-be43-9c91a230f192 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.126453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bc280-0a18-429b-be43-9c91a230f192 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.126771 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bc280-0a18-429b-be43-9c91a230f192 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.127706 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bc280-0a18-429b-be43-9c91a230f192 None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:27.128078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bc280-0a18-429b-be43-9c91a230f192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:27.130780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bc280-0a18-429b-be43-9c91a230f192 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:27.133968 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40913e-46cc-4dbe-b977-8f7781471ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:27.135970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40913e-46cc-4dbe-b977-8f7781471ddc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:27.142942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 240/488] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:27.145071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3789841-96f0-4947-ad16-6b9b6f876ebc None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.145433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3789841-96f0-4947-ad16-6b9b6f876ebc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.146233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3789841-96f0-4947-ad16-6b9b6f876ebc None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.152426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 241/489] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:27.152426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3789841-96f0-4947-ad16-6b9b6f876ebc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-fb40913e-46cc-4dbe-b977-8f7781471ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:27.163815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:27.165065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:27.165945 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:27.165945 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:27.165945 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:27.165945 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:27.166974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 249/490] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:27.170193 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6512738-8e2b-4d80-9019-c958a627afaa None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.170760 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6512738-8e2b-4d80-9019-c958a627afaa None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.171240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6512738-8e2b-4d80-9019-c958a627afaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.191917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e6512738-8e2b-4d80-9019-c958a627afaa None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:27.193898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e6512738-8e2b-4d80-9019-c958a627afaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:27.215232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:27.229030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:27.276457 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 250/491] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:27.277681 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6512738-8e2b-4d80-9019-c958a627afaa None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:27.313962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3789841-96f0-4947-ad16-6b9b6f876ebc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:27.363055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35f00f-d6da-4edd-a150-a045ec0144ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:27.364849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f00f-d6da-4edd-a150-a045ec0144ee None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.365343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f00f-d6da-4edd-a150-a045ec0144ee None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.365898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f00f-d6da-4edd-a150-a045ec0144ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.378675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35f00f-d6da-4edd-a150-a045ec0144ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:27.381251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35f00f-d6da-4edd-a150-a045ec0144ee None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-9d35f00f-d6da-4edd-a150-a045ec0144ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:27.404777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:27.405696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:27.406547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:27.406547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:27.406547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:27.406547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:27.409154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 242/492] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:27.410094 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35f00f-d6da-4edd-a150-a045ec0144ee None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:27.415863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6512738-8e2b-4d80-9019-c958a627afaa None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:27.453040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59edcc3-eba1-415e-8407-7513eb91dcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:27.453765 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edcc3-eba1-415e-8407-7513eb91dcff None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.454055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edcc3-eba1-415e-8407-7513eb91dcff None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.454416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edcc3-eba1-415e-8407-7513eb91dcff None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.455124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59edcc3-eba1-415e-8407-7513eb91dcff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:27.455434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59edcc3-eba1-415e-8407-7513eb91dcff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:27.456964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59edcc3-eba1-415e-8407-7513eb91dcff None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:27.469304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 251/493] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:27.470211 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59edcc3-eba1-415e-8407-7513eb91dcff None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:27.496874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:27.549067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:27.559330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35f00f-d6da-4edd-a150-a045ec0144ee None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:27.579399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59edcc3-eba1-415e-8407-7513eb91dcff None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:27.603782 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2c00-c999-4284-b95f-164bf9569f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:27.604805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2c00-c999-4284-b95f-164bf9569f7b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.605101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2c00-c999-4284-b95f-164bf9569f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.605440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2c00-c999-4284-b95f-164bf9569f7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.615717 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c3299-96c4-4f5c-8df2-a046f7223667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:27.616322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3299-96c4-4f5c-8df2-a046f7223667 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.616626 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3299-96c4-4f5c-8df2-a046f7223667 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.617009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3299-96c4-4f5c-8df2-a046f7223667 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.617820 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c3299-96c4-4f5c-8df2-a046f7223667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:27.618106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2c00-c999-4284-b95f-164bf9569f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:27.625136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c3299-96c4-4f5c-8df2-a046f7223667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:27.626871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c3299-96c4-4f5c-8df2-a046f7223667 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ef9c2c00-c999-4284-b95f-164bf9569f7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:27.627587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:27.628451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:27.629306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 243/494] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:27.630558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2c00-c999-4284-b95f-164bf9569f7b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:27.644081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 252/495] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:27.646645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b86e-59e0-4cbe-a433-6744dca32866 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.647003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b86e-59e0-4cbe-a433-6744dca32866 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.647353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b86e-59e0-4cbe-a433-6744dca32866 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.649157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 253/496] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:27.649726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b86e-59e0-4cbe-a433-6744dca32866 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:27.739831 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:27.757403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2c00-c999-4284-b95f-164bf9569f7b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:27.761054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b86e-59e0-4cbe-a433-6744dca32866 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:27.797103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e6baa-2ee3-42e5-a797-78a6af3f179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:27.797304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082e017-940d-4b1c-802f-d12b793ef8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:27.797865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082e017-940d-4b1c-802f-d12b793ef8dd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.797979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6baa-2ee3-42e5-a797-78a6af3f179c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.798148 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082e017-940d-4b1c-802f-d12b793ef8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.798249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6baa-2ee3-42e5-a797-78a6af3f179c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.798425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082e017-940d-4b1c-802f-d12b793ef8dd None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.798525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6baa-2ee3-42e5-a797-78a6af3f179c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.799179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082e017-940d-4b1c-802f-d12b793ef8dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:27.799478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082e017-940d-4b1c-802f-d12b793ef8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:27.800892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082e017-940d-4b1c-802f-d12b793ef8dd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:27.806678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e6baa-2ee3-42e5-a797-78a6af3f179c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:27.808128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e6baa-2ee3-42e5-a797-78a6af3f179c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:27.810360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 254/497] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:27.811141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082e017-940d-4b1c-802f-d12b793ef8dd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-e93e6baa-2ee3-42e5-a797-78a6af3f179c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:27.828374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:27.829391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:27.830298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:27.830298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:27.830298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:27.830298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:27.830298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:27.830298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:27.830298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:27.830298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:27.830298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:27.830298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:27.830298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 244/498] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jun 20 06:00:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:27.830891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698e752-bf13-4bac-becd-81c357685df5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.831117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698e752-bf13-4bac-becd-81c357685df5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.831327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698e752-bf13-4bac-becd-81c357685df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.848077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a698e752-bf13-4bac-becd-81c357685df5 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:27.850040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a698e752-bf13-4bac-becd-81c357685df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:27.859357 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:27.916645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 245/499] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:27.917408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082e017-940d-4b1c-802f-d12b793ef8dd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:27.917935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b53dd-a8c5-4737-88db-8bff7a5aff3c None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.918226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b53dd-a8c5-4737-88db-8bff7a5aff3c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.918501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b53dd-a8c5-4737-88db-8bff7a5aff3c None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.920395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 246/500] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:27.920777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b53dd-a8c5-4737-88db-8bff7a5aff3c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:27.958584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c653186-ed9b-439d-89dd-cdb2804b8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:27.960111 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c653186-ed9b-439d-89dd-cdb2804b8917 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:27.960538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c653186-ed9b-439d-89dd-cdb2804b8917 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:27.961020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c653186-ed9b-439d-89dd-cdb2804b8917 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:27.969610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c653186-ed9b-439d-89dd-cdb2804b8917 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:27.971922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c653186-ed9b-439d-89dd-cdb2804b8917 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-0c653186-ed9b-439d-89dd-cdb2804b8917 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:27.991599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:27.992543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:27.993578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:27.993578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:27.993578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:27.993578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:27.993578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:27.993578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:27.993578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:27.993578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:27.993578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 06:00:27.993578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:27.993578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 255/501] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:27.994152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c653186-ed9b-439d-89dd-cdb2804b8917 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:27.998393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:28.030556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b53dd-a8c5-4737-88db-8bff7a5aff3c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:28.065117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d964f2-e27a-4a65-9cbb-a2e7f744345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:28.065910 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d964f2-e27a-4a65-9cbb-a2e7f744345d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.066197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d964f2-e27a-4a65-9cbb-a2e7f744345d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.066475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d964f2-e27a-4a65-9cbb-a2e7f744345d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.076500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d964f2-e27a-4a65-9cbb-a2e7f744345d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:28.078029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d964f2-e27a-4a65-9cbb-a2e7f744345d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:28.080482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-85d964f2-e27a-4a65-9cbb-a2e7f744345d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:28.096980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:28.098020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:28.099465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:28.099465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:28.099465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:28.099465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:28.099681 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c653186-ed9b-439d-89dd-cdb2804b8917 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:28.099753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 247/502] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:28.101313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9b302-5ff3-46d0-9c23-571db8f27c13 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.101598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9b302-5ff3-46d0-9c23-571db8f27c13 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.101933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9b302-5ff3-46d0-9c23-571db8f27c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.118872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4ee9b302-5ff3-46d0-9c23-571db8f27c13 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:28.120042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4ee9b302-5ff3-46d0-9c23-571db8f27c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:28.132983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0028-a0fc-4f80-9f63-26983ae8accb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:28.133647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0028-a0fc-4f80-9f63-26983ae8accb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.133932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0028-a0fc-4f80-9f63-26983ae8accb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.134210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0028-a0fc-4f80-9f63-26983ae8accb None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.135038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa0028-a0fc-4f80-9f63-26983ae8accb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:28.135349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa0028-a0fc-4f80-9f63-26983ae8accb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:28.136811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa0028-a0fc-4f80-9f63-26983ae8accb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:28.174441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 256/503] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jun 20 06:00:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:28.175194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0028-a0fc-4f80-9f63-26983ae8accb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:28.193942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 248/504] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:28.194786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9b302-5ff3-46d0-9c23-571db8f27c13 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:28.239911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:28.280016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0028-a0fc-4f80-9f63-26983ae8accb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:28.305563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9b302-5ff3-46d0-9c23-571db8f27c13 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:28.316467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bf3cf-9276-4bf3-bbe0-4d1b528bd8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:28.317348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bf3cf-9276-4bf3-bbe0-4d1b528bd8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.318070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bf3cf-9276-4bf3-bbe0-4d1b528bd8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.318070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bf3cf-9276-4bf3-bbe0-4d1b528bd8c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.328074 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bf3cf-9276-4bf3-bbe0-4d1b528bd8c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:28.332680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-c29bf3cf-9276-4bf3-bbe0-4d1b528bd8c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:28.336446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:28.337566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 257/505] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:28.339192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bf3cf-9276-4bf3-bbe0-4d1b528bd8c5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:28.345747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029e22f-f19a-4915-a822-4ccb64d26674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:28.346427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029e22f-f19a-4915-a822-4ccb64d26674 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.346711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029e22f-f19a-4915-a822-4ccb64d26674 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.346990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029e22f-f19a-4915-a822-4ccb64d26674 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.347840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029e22f-f19a-4915-a822-4ccb64d26674 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:28.348151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029e22f-f19a-4915-a822-4ccb64d26674 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:28.350642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029e22f-f19a-4915-a822-4ccb64d26674 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:28.386966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 249/506] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jun 20 06:00:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:28.387785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029e22f-f19a-4915-a822-4ccb64d26674 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:28.450638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bf3cf-9276-4bf3-bbe0-4d1b528bd8c5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:28.475430 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:28.488243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535521ae-5fa8-465f-bc6b-40cea2178f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:28.488942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535521ae-5fa8-465f-bc6b-40cea2178f5c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.489043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029e22f-f19a-4915-a822-4ccb64d26674 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:28.489292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535521ae-5fa8-465f-bc6b-40cea2178f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.490157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535521ae-5fa8-465f-bc6b-40cea2178f5c None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.490987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535521ae-5fa8-465f-bc6b-40cea2178f5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:28.491305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535521ae-5fa8-465f-bc6b-40cea2178f5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:28.492746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535521ae-5fa8-465f-bc6b-40cea2178f5c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:28.504195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 258/507] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:28.505087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535521ae-5fa8-465f-bc6b-40cea2178f5c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:28.523878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951291a-fb09-4854-913d-323c42c25f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:28.524525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951291a-fb09-4854-913d-323c42c25f68 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.524863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951291a-fb09-4854-913d-323c42c25f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.525142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951291a-fb09-4854-913d-323c42c25f68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.576467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:28.593524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951291a-fb09-4854-913d-323c42c25f68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:28.595021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951291a-fb09-4854-913d-323c42c25f68 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:28.610648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535521ae-5fa8-465f-bc6b-40cea2178f5c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:28.646861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e785f-2b0f-4d68-a308-21ffbd6ed931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:28.647660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e785f-2b0f-4d68-a308-21ffbd6ed931 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.647951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e785f-2b0f-4d68-a308-21ffbd6ed931 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.648230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e785f-2b0f-4d68-a308-21ffbd6ed931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.658091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e785f-2b0f-4d68-a308-21ffbd6ed931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:28.659812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e785f-2b0f-4d68-a308-21ffbd6ed931 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e08e785f-2b0f-4d68-a308-21ffbd6ed931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:28.677810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:28.678693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:28.679559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:28.679559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:28.679559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:28.679559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:28.679559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 259/508] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:28.679838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e785f-2b0f-4d68-a308-21ffbd6ed931 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:28.710128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 250/509] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:28.711072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951291a-fb09-4854-913d-323c42c25f68 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:28.721242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:28.786932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e785f-2b0f-4d68-a308-21ffbd6ed931 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:28.803723 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:28.820640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03f28a-a442-4886-acef-e8bca430398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:28.820811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951291a-fb09-4854-913d-323c42c25f68 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:28.821311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03f28a-a442-4886-acef-e8bca430398e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.821603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03f28a-a442-4886-acef-e8bca430398e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.821886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03f28a-a442-4886-acef-e8bca430398e None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.822637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03f28a-a442-4886-acef-e8bca430398e None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:28.822955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03f28a-a442-4886-acef-e8bca430398e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:28.824336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03f28a-a442-4886-acef-e8bca430398e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:28.832222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 260/510] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:28.833055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03f28a-a442-4886-acef-e8bca430398e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:28.855545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ed90-b990-41eb-b3cd-d4023b12e8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:28.856191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ed90-b990-41eb-b3cd-d4023b12e8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.856476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ed90-b990-41eb-b3cd-d4023b12e8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.856791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ed90-b990-41eb-b3cd-d4023b12e8f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.925215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531ed90-b990-41eb-b3cd-d4023b12e8f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:28.925443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:28.927219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531ed90-b990-41eb-b3cd-d4023b12e8f0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:28.932108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03f28a-a442-4886-acef-e8bca430398e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:28.964860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454fee0-6f4b-4e88-ae54-6107cab75666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:28.965581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454fee0-6f4b-4e88-ae54-6107cab75666 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.965867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454fee0-6f4b-4e88-ae54-6107cab75666 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.966144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454fee0-6f4b-4e88-ae54-6107cab75666 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.973432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454fee0-6f4b-4e88-ae54-6107cab75666 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:28.975590 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454fee0-6f4b-4e88-ae54-6107cab75666 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f454fee0-6f4b-4e88-ae54-6107cab75666 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:28.990219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:28.991182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:28.992080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:28.992080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:28.992080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:28.992080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:28.992080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:28.992080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:28.992080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:28.992080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:28.992080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 06:00:28.992080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:28.992080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 261/511] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:28.992672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454fee0-6f4b-4e88-ae54-6107cab75666 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:29.014318 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:29.030446 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 251/512] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:29.031246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ed90-b990-41eb-b3cd-d4023b12e8f0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:29.093037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454fee0-6f4b-4e88-ae54-6107cab75666 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:29.125976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12aea-8e6d-431a-996a-d977c5c96bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:29.126632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12aea-8e6d-431a-996a-d977c5c96bbc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:29.126919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12aea-8e6d-431a-996a-d977c5c96bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:29.127198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12aea-8e6d-431a-996a-d977c5c96bbc None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:29.127949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac12aea-8e6d-431a-996a-d977c5c96bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:29.128261 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac12aea-8e6d-431a-996a-d977c5c96bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:29.129687 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac12aea-8e6d-431a-996a-d977c5c96bbc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:29.130937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ed90-b990-41eb-b3cd-d4023b12e8f0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:29.142172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 262/513] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:29.142964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12aea-8e6d-431a-996a-d977c5c96bbc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:29.164172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:29.165224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc0598-2a73-4f26-9d8f-a66c8aadcd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:29.166028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc0598-2a73-4f26-9d8f-a66c8aadcd46 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:29.166337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc0598-2a73-4f26-9d8f-a66c8aadcd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:29.166593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc0598-2a73-4f26-9d8f-a66c8aadcd46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:29.176477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc0598-2a73-4f26-9d8f-a66c8aadcd46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:29.178075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc0598-2a73-4f26-9d8f-a66c8aadcd46 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1bcc0598-2a73-4f26-9d8f-a66c8aadcd46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:29.195761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:29.197367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:29.198328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:29.198328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:29.198328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:29.198328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:29.198328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 252/514] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:29.198328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc0598-2a73-4f26-9d8f-a66c8aadcd46 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:29.233548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:29.247420 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12aea-8e6d-431a-996a-d977c5c96bbc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:29.284943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459156-4d14-453b-aca6-f9f90e96415c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:29.285743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459156-4d14-453b-aca6-f9f90e96415c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:29.286084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459156-4d14-453b-aca6-f9f90e96415c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:29.286464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459156-4d14-453b-aca6-f9f90e96415c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:29.296354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2459156-4d14-453b-aca6-f9f90e96415c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:29.297887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2459156-4d14-453b-aca6-f9f90e96415c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:29.300593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc0598-2a73-4f26-9d8f-a66c8aadcd46 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-d2459156-4d14-453b-aca6-f9f90e96415c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:29.316924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:29.318084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:29.319129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:29.319129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:29.319129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:29.319129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:29.319129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 263/515] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:29.319129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459156-4d14-453b-aca6-f9f90e96415c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:29.337965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da1194-b17e-4588-84ea-2d34cc012116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:29.338639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da1194-b17e-4588-84ea-2d34cc012116 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:29.338927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da1194-b17e-4588-84ea-2d34cc012116 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:29.339208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da1194-b17e-4588-84ea-2d34cc012116 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:29.340046 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da1194-b17e-4588-84ea-2d34cc012116 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:29.340366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da1194-b17e-4588-84ea-2d34cc012116 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:29.341853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da1194-b17e-4588-84ea-2d34cc012116 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:29.360133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 253/516] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jun 20 06:00:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:29.360977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da1194-b17e-4588-84ea-2d34cc012116 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:29.385892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:29.420839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459156-4d14-453b-aca6-f9f90e96415c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:29.453860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11afad5-796b-48e2-8a72-a6231915735f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:29.454655 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11afad5-796b-48e2-8a72-a6231915735f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:29.454942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11afad5-796b-48e2-8a72-a6231915735f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:29.455221 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11afad5-796b-48e2-8a72-a6231915735f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:29.455627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:29.463598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da1194-b17e-4588-84ea-2d34cc012116 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:29.466161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11afad5-796b-48e2-8a72-a6231915735f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:29.467618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11afad5-796b-48e2-8a72-a6231915735f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b11afad5-796b-48e2-8a72-a6231915735f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:29.485553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:29.486564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:29.487630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:29.487630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:29.487630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:29.487630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:29.487630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 264/517] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:29.487630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11afad5-796b-48e2-8a72-a6231915735f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:29.502413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db004e-b81d-4a0f-88ee-385979eec339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:29.503292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db004e-b81d-4a0f-88ee-385979eec339 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:29.503766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db004e-b81d-4a0f-88ee-385979eec339 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:29.504079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db004e-b81d-4a0f-88ee-385979eec339 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:29.504890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db004e-b81d-4a0f-88ee-385979eec339 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:29.506359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db004e-b81d-4a0f-88ee-385979eec339 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:29.527135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 254/518] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 06:00:29 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:00:29.527961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db004e-b81d-4a0f-88ee-385979eec339 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:29.595845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11afad5-796b-48e2-8a72-a6231915735f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:29.619818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:29.640120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb2b22-387e-4a47-9eaa-897db5745bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:29.640832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb2b22-387e-4a47-9eaa-897db5745bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:29.641122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb2b22-387e-4a47-9eaa-897db5745bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:29.641391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb2b22-387e-4a47-9eaa-897db5745bd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:29.642135 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb2b22-387e-4a47-9eaa-897db5745bd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:29.642442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb2b22-387e-4a47-9eaa-897db5745bd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:29.643839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb2b22-387e-4a47-9eaa-897db5745bd7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:29.656738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 265/519] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:29.657505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb2b22-387e-4a47-9eaa-897db5745bd7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:29.673802 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db004e-b81d-4a0f-88ee-385979eec339 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:29.714811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e2c5a-6ef5-47e1-a78e-7551007b19dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:29.715494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e2c5a-6ef5-47e1-a78e-7551007b19dd None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:29.716317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e2c5a-6ef5-47e1-a78e-7551007b19dd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:29.716317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e2c5a-6ef5-47e1-a78e-7551007b19dd None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:29.716824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e2c5a-6ef5-47e1-a78e-7551007b19dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:29.717138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e2c5a-6ef5-47e1-a78e-7551007b19dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:29.718551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e2c5a-6ef5-47e1-a78e-7551007b19dd None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:29.732178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 255/520] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:29.733127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e2c5a-6ef5-47e1-a78e-7551007b19dd None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:29.746362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:29.774026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb2b22-387e-4a47-9eaa-897db5745bd7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:29.808160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe80ce2-b10c-47ac-8377-1cbe2649f14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:29.808836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80ce2-b10c-47ac-8377-1cbe2649f14f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:29.809127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80ce2-b10c-47ac-8377-1cbe2649f14f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:29.809412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80ce2-b10c-47ac-8377-1cbe2649f14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:29.849199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e2c5a-6ef5-47e1-a78e-7551007b19dd None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:29.880986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:29.888246 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe80ce2-b10c-47ac-8377-1cbe2649f14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:29.890363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe80ce2-b10c-47ac-8377-1cbe2649f14f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:29.910691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d0e36-eb5c-4a64-982b-492835b1b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:29.912457 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d0e36-eb5c-4a64-982b-492835b1b35b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:29.912974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d0e36-eb5c-4a64-982b-492835b1b35b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:29.913620 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d0e36-eb5c-4a64-982b-492835b1b35b None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:29.914925 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d0e36-eb5c-4a64-982b-492835b1b35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:29.915420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d0e36-eb5c-4a64-982b-492835b1b35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:29.917041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d0e36-eb5c-4a64-982b-492835b1b35b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:29.930511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 256/521] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:29.931719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d0e36-eb5c-4a64-982b-492835b1b35b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:30.020224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 266/522] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:30.022305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe80ce2-b10c-47ac-8377-1cbe2649f14f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:30.038893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:30.087157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d0e36-eb5c-4a64-982b-492835b1b35b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:30.130676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:30.134293 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017ac25-6b7b-49e7-9356-baabff6f768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:30.135124 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017ac25-6b7b-49e7-9356-baabff6f768b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:30.135404 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017ac25-6b7b-49e7-9356-baabff6f768b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:30.135681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017ac25-6b7b-49e7-9356-baabff6f768b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:30.143548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017ac25-6b7b-49e7-9356-baabff6f768b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:30.145066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017ac25-6b7b-49e7-9356-baabff6f768b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:30.154809 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe80ce2-b10c-47ac-8377-1cbe2649f14f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-a017ac25-6b7b-49e7-9356-baabff6f768b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:30.165240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:30.166141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:30.167008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:30.167008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:30.167008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:30.167008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:30.167008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:30.167008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:30.167008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:30.167008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:30.171117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 257/523] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:30.172041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017ac25-6b7b-49e7-9356-baabff6f768b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:30.200086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bf09f-f3e0-411c-b413-7fde3e40d9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:30.200949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bf09f-f3e0-411c-b413-7fde3e40d9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:30.201237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bf09f-f3e0-411c-b413-7fde3e40d9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:30.201519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bf09f-f3e0-411c-b413-7fde3e40d9e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:30.211328 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bf09f-f3e0-411c-b413-7fde3e40d9e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:30.212840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bf09f-f3e0-411c-b413-7fde3e40d9e6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-618bf09f-f3e0-411c-b413-7fde3e40d9e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:30.228238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:30.229249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 267/524] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:30.230311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bf09f-f3e0-411c-b413-7fde3e40d9e6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:30.305539 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017ac25-6b7b-49e7-9356-baabff6f768b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:30.339669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:30.347274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa40a75-f0cc-4829-b070-b69365171eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:30.348078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa40a75-f0cc-4829-b070-b69365171eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:30.348368 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa40a75-f0cc-4829-b070-b69365171eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:30.348717 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa40a75-f0cc-4829-b070-b69365171eb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:30.356027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa40a75-f0cc-4829-b070-b69365171eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:30.356737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bf09f-f3e0-411c-b413-7fde3e40d9e6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:30.357529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa40a75-f0cc-4829-b070-b69365171eb1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ffa40a75-f0cc-4829-b070-b69365171eb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:30.373821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:30.374690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:30.375563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:30.375563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:30.375563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:30.375563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:30.375563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:30.375563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:30.375563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:30.375563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:30.375563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 258/525] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:30.376105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa40a75-f0cc-4829-b070-b69365171eb1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:30.398975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78464897-be7e-4f16-a447-a34358dd4521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:30.399778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78464897-be7e-4f16-a447-a34358dd4521 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:30.400070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78464897-be7e-4f16-a447-a34358dd4521 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:30.400354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78464897-be7e-4f16-a447-a34358dd4521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:30.408476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:30.411737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78464897-be7e-4f16-a447-a34358dd4521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:30.413484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78464897-be7e-4f16-a447-a34358dd4521 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-78464897-be7e-4f16-a447-a34358dd4521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:30.432531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:30.433643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:30.434519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:30.434519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:30.434519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:30.434519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:30.434519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 268/526] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:30.434519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78464897-be7e-4f16-a447-a34358dd4521 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:30.490951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa40a75-f0cc-4829-b070-b69365171eb1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:30.527378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43b270-7df2-4dae-81e6-0d450c4d9dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:30.528043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43b270-7df2-4dae-81e6-0d450c4d9dff None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:30.528337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43b270-7df2-4dae-81e6-0d450c4d9dff None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:30.528637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43b270-7df2-4dae-81e6-0d450c4d9dff None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:30.529445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43b270-7df2-4dae-81e6-0d450c4d9dff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:30.529769 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43b270-7df2-4dae-81e6-0d450c4d9dff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:30.531236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43b270-7df2-4dae-81e6-0d450c4d9dff None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:30.542186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78464897-be7e-4f16-a447-a34358dd4521 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:30.555151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 259/527] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:30.555151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43b270-7df2-4dae-81e6-0d450c4d9dff None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:30.584691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580a401-f55d-48b5-824b-8e8cf5f75fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:30.585478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580a401-f55d-48b5-824b-8e8cf5f75fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:30.585887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580a401-f55d-48b5-824b-8e8cf5f75fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:30.586173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580a401-f55d-48b5-824b-8e8cf5f75fc7 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:30.587016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580a401-f55d-48b5-824b-8e8cf5f75fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:30.587328 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580a401-f55d-48b5-824b-8e8cf5f75fc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:30.588992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580a401-f55d-48b5-824b-8e8cf5f75fc7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:30.611729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 269/528] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Jun 20 06:00:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:30.611909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:30.612004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580a401-f55d-48b5-824b-8e8cf5f75fc7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:30.669131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:30.673157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43b270-7df2-4dae-81e6-0d450c4d9dff None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:30.713119 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96dc8d-29a0-427a-80c8-737660c92ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:30.714071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96dc8d-29a0-427a-80c8-737660c92ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:30.714366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96dc8d-29a0-427a-80c8-737660c92ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:30.714649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96dc8d-29a0-427a-80c8-737660c92ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:30.716145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96dc8d-29a0-427a-80c8-737660c92ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:30.716444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96dc8d-29a0-427a-80c8-737660c92ad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:30.718468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96dc8d-29a0-427a-80c8-737660c92ad9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:30.725183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580a401-f55d-48b5-824b-8e8cf5f75fc7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:30.740240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 260/529] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:30.740240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96dc8d-29a0-427a-80c8-737660c92ad9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:30.761250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb89835-4110-4ccd-97b7-2fb461ad4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:30.761920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89835-4110-4ccd-97b7-2fb461ad4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:30.762210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89835-4110-4ccd-97b7-2fb461ad4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:30.762499 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89835-4110-4ccd-97b7-2fb461ad4ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:30.763223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb89835-4110-4ccd-97b7-2fb461ad4ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:30.763537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb89835-4110-4ccd-97b7-2fb461ad4ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:30.764937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb89835-4110-4ccd-97b7-2fb461ad4ca6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:30.776725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 270/530] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:30.777521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb89835-4110-4ccd-97b7-2fb461ad4ca6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:30.857865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96dc8d-29a0-427a-80c8-737660c92ad9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:30.868991 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:30.890692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb89835-4110-4ccd-97b7-2fb461ad4ca6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:30.893312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05af49-19f0-447c-92f1-04409b8a1f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:30.894036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05af49-19f0-447c-92f1-04409b8a1f0e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:30.894323 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05af49-19f0-447c-92f1-04409b8a1f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:30.894596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05af49-19f0-447c-92f1-04409b8a1f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:30.895941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05af49-19f0-447c-92f1-04409b8a1f0e None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=3748d8369d20429eb2376ce02d42eee0) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:30.896745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05af49-19f0-447c-92f1-04409b8a1f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:30.898184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05af49-19f0-447c-92f1-04409b8a1f0e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:30.902362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:30.904061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 261/531] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:30 2022] GET /identity/v3/role_assignments?user.id=3748d8369d20429eb2376ce02d42eee0&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:30.904804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05af49-19f0-447c-92f1-04409b8a1f0e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:30.933118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe251c94-ae6c-42a9-8cfe-da102b86aa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:30.934385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe251c94-ae6c-42a9-8cfe-da102b86aa0e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:30.934880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe251c94-ae6c-42a9-8cfe-da102b86aa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:30.935411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe251c94-ae6c-42a9-8cfe-da102b86aa0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.019651 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05af49-19f0-447c-92f1-04409b8a1f0e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:31.020101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe251c94-ae6c-42a9-8cfe-da102b86aa0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:31.022397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe251c94-ae6c-42a9-8cfe-da102b86aa0e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:31.059394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70f38b-8bd3-4cc8-a8c0-ca8379a4532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:31.060215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70f38b-8bd3-4cc8-a8c0-ca8379a4532b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.060533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70f38b-8bd3-4cc8-a8c0-ca8379a4532b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.060909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70f38b-8bd3-4cc8-a8c0-ca8379a4532b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.061835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70f38b-8bd3-4cc8-a8c0-ca8379a4532b None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=3780488ee9404b3b8eda52acf8dceca3) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:31.062221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70f38b-8bd3-4cc8-a8c0-ca8379a4532b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:31.063780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70f38b-8bd3-4cc8-a8c0-ca8379a4532b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:31.077059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 262/532] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:30 2022] GET /identity/v3/role_assignments?user.id=3780488ee9404b3b8eda52acf8dceca3&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:31.078157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70f38b-8bd3-4cc8-a8c0-ca8379a4532b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:31.157111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:31.170579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 271/533] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:31.178442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe251c94-ae6c-42a9-8cfe-da102b86aa0e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:31.196300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:31.273846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70f38b-8bd3-4cc8-a8c0-ca8379a4532b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:31.321246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03597fc1-b235-4473-adc9-89d5f6076e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:31.322168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597fc1-b235-4473-adc9-89d5f6076e81 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.322526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597fc1-b235-4473-adc9-89d5f6076e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.322881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597fc1-b235-4473-adc9-89d5f6076e81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.332192 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03597fc1-b235-4473-adc9-89d5f6076e81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:31.334309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03597fc1-b235-4473-adc9-89d5f6076e81 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-03597fc1-b235-4473-adc9-89d5f6076e81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:31.352330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:31.353262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:31.354155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:31.354155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:31.354155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:31.354155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:31.354155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:31.354155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:31.354155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:31.354155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:31.354155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 263/534] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:31.355715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe251c94-ae6c-42a9-8cfe-da102b86aa0e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:31.365857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03597fc1-b235-4473-adc9-89d5f6076e81 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:31.402500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c155f70-5a9a-48f8-8197-9c25bb54c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:31.403325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c155f70-5a9a-48f8-8197-9c25bb54c102 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.403604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c155f70-5a9a-48f8-8197-9c25bb54c102 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.403877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c155f70-5a9a-48f8-8197-9c25bb54c102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.416208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c155f70-5a9a-48f8-8197-9c25bb54c102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:31.417619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c155f70-5a9a-48f8-8197-9c25bb54c102 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-1c155f70-5a9a-48f8-8197-9c25bb54c102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:31.437004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:31.439055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:31.440561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:31.440561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:31.440561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:31.440561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:31.440561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 272/535] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:31.444205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c155f70-5a9a-48f8-8197-9c25bb54c102 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:31.514863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:31.558267 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c155f70-5a9a-48f8-8197-9c25bb54c102 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:31.597183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c8e2d-d658-4090-a28b-5f1d7df7899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:31.597997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c8e2d-d658-4090-a28b-5f1d7df7899e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.598352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c8e2d-d658-4090-a28b-5f1d7df7899e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.598766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c8e2d-d658-4090-a28b-5f1d7df7899e None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.599735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c8e2d-d658-4090-a28b-5f1d7df7899e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:31.600114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c8e2d-d658-4090-a28b-5f1d7df7899e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:31.601859 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c8e2d-d658-4090-a28b-5f1d7df7899e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:31.615228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 273/536] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:31.624010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c8e2d-d658-4090-a28b-5f1d7df7899e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:31.636206 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:31.645703 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03597fc1-b235-4473-adc9-89d5f6076e81 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:31.695500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54689f1c-d496-4879-a012-a3ff600ecc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:31.696241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54689f1c-d496-4879-a012-a3ff600ecc41 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.696512 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54689f1c-d496-4879-a012-a3ff600ecc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.696830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54689f1c-d496-4879-a012-a3ff600ecc41 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.698139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54689f1c-d496-4879-a012-a3ff600ecc41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:31.698476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54689f1c-d496-4879-a012-a3ff600ecc41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:31.700209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54689f1c-d496-4879-a012-a3ff600ecc41 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:31.717196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 264/537] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:31.718726 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa5c2d-781b-4ade-8ff6-d88afdbaa56b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.719031 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa5c2d-781b-4ade-8ff6-d88afdbaa56b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.719312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa5c2d-781b-4ade-8ff6-d88afdbaa56b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.724781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 265/538] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:31.726746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa5c2d-781b-4ade-8ff6-d88afdbaa56b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:31.763731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c8e2d-d658-4090-a28b-5f1d7df7899e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:31.789489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:31.805099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472a4c6-1e65-4b3a-bdde-478ce6235066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:31.806494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472a4c6-1e65-4b3a-bdde-478ce6235066 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.806790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472a4c6-1e65-4b3a-bdde-478ce6235066 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.807074 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472a4c6-1e65-4b3a-bdde-478ce6235066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.815548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472a4c6-1e65-4b3a-bdde-478ce6235066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:31.818156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472a4c6-1e65-4b3a-bdde-478ce6235066 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f472a4c6-1e65-4b3a-bdde-478ce6235066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:31.838628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:31.839528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:31.840387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:31.840387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:31.840387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:31.840387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:31.840387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:31.840387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:31.840387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:31.840387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:31.845069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 274/539] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:31.846348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f43d-91a3-4221-a5d5-48600dacd7be None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.846643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f43d-91a3-4221-a5d5-48600dacd7be None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.846926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f43d-91a3-4221-a5d5-48600dacd7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.857326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa5c2d-781b-4ade-8ff6-d88afdbaa56b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:31.871035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9498f43d-91a3-4221-a5d5-48600dacd7be None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:31.873140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9498f43d-91a3-4221-a5d5-48600dacd7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:31.898052 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be96f80-ea03-4676-a6a3-6a69d32b12a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:31.898725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be96f80-ea03-4676-a6a3-6a69d32b12a5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.899018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be96f80-ea03-4676-a6a3-6a69d32b12a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.899298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be96f80-ea03-4676-a6a3-6a69d32b12a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.900135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be96f80-ea03-4676-a6a3-6a69d32b12a5 None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=7071b87350864e478e848e7d3d66e33e) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:31.900454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be96f80-ea03-4676-a6a3-6a69d32b12a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:31.901945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be96f80-ea03-4676-a6a3-6a69d32b12a5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:31.916656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 266/540] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:31 2022] GET /identity/v3/role_assignments?user.id=7071b87350864e478e848e7d3d66e33e&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:31.916656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be96f80-ea03-4676-a6a3-6a69d32b12a5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:31.942940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:32.020199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 275/541] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:32.045886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498f43d-91a3-4221-a5d5-48600dacd7be None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:32.078780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be96f80-ea03-4676-a6a3-6a69d32b12a5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:32.154888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092344d-399f-4a96-acfe-db4f1e051818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:32.155573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092344d-399f-4a96-acfe-db4f1e051818 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:32.155861 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092344d-399f-4a96-acfe-db4f1e051818 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:32.156141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092344d-399f-4a96-acfe-db4f1e051818 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:32.157010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092344d-399f-4a96-acfe-db4f1e051818 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:32.157328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092344d-399f-4a96-acfe-db4f1e051818 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:32.158853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092344d-399f-4a96-acfe-db4f1e051818 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:32.189862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 267/542] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:32.196185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092344d-399f-4a96-acfe-db4f1e051818 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:32.238566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498f43d-91a3-4221-a5d5-48600dacd7be None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:32.267553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:32.308234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d6d0d-7e75-41c2-86a3-9cb5cbdbde17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:32.308992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d6d0d-7e75-41c2-86a3-9cb5cbdbde17 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:32.309285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d6d0d-7e75-41c2-86a3-9cb5cbdbde17 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:32.309560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d6d0d-7e75-41c2-86a3-9cb5cbdbde17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:32.339351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d6d0d-7e75-41c2-86a3-9cb5cbdbde17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b18d6d0d-7e75-41c2-86a3-9cb5cbdbde17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:32.352986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:32.353902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:32.354724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 276/543] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:32.360743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d6d0d-7e75-41c2-86a3-9cb5cbdbde17 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:32.361010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:32.392485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092344d-399f-4a96-acfe-db4f1e051818 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:32.448318 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2119a-99bd-4d7e-83a8-f83876546b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:32.449025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2119a-99bd-4d7e-83a8-f83876546b9a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:32.449315 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2119a-99bd-4d7e-83a8-f83876546b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:32.449654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2119a-99bd-4d7e-83a8-f83876546b9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:32.450505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2119a-99bd-4d7e-83a8-f83876546b9a None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=9d21089ce5b140ab9549816b8cb38316) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:32.450862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2119a-99bd-4d7e-83a8-f83876546b9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:32.452325 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2119a-99bd-4d7e-83a8-f83876546b9a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:32.458510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 268/544] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:32 2022] GET /identity/v3/role_assignments?user.id=9d21089ce5b140ab9549816b8cb38316&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:32.550832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d6d0d-7e75-41c2-86a3-9cb5cbdbde17 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:32.606424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41e45-482c-4465-82d9-e0cae96d5d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:32.607128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41e45-482c-4465-82d9-e0cae96d5d4e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:32.607416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41e45-482c-4465-82d9-e0cae96d5d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:32.607705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c41e45-482c-4465-82d9-e0cae96d5d4e None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:32.608535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41e45-482c-4465-82d9-e0cae96d5d4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:32.608877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41e45-482c-4465-82d9-e0cae96d5d4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:32.610324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c41e45-482c-4465-82d9-e0cae96d5d4e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:32.623768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 277/545] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:32.636662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2119a-99bd-4d7e-83a8-f83876546b9a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:32.774939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2119a-99bd-4d7e-83a8-f83876546b9a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:32.825567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d347aa-2055-4c55-990f-03f113c2c7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:32.826729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d347aa-2055-4c55-990f-03f113c2c7db None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:32.827214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d347aa-2055-4c55-990f-03f113c2c7db None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:32.827685 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d347aa-2055-4c55-990f-03f113c2c7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:32.844101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d347aa-2055-4c55-990f-03f113c2c7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:32.846034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d347aa-2055-4c55-990f-03f113c2c7db None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:32.852978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-59d347aa-2055-4c55-990f-03f113c2c7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:32.864477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:32.865493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:32.866390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:32.866390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:32.866390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:32.866390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:32.866390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 269/546] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:32.872734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41e45-482c-4465-82d9-e0cae96d5d4e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:32.944988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:33.041331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c41e45-482c-4465-82d9-e0cae96d5d4e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:33.092449 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86607f24-f883-4a03-953e-55afa60040c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:33.093145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86607f24-f883-4a03-953e-55afa60040c0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.093431 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86607f24-f883-4a03-953e-55afa60040c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.093711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86607f24-f883-4a03-953e-55afa60040c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.094441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86607f24-f883-4a03-953e-55afa60040c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:33.094750 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86607f24-f883-4a03-953e-55afa60040c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:33.096127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86607f24-f883-4a03-953e-55afa60040c0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:33.109302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 278/547] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:33.117771 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d347aa-2055-4c55-990f-03f113c2c7db None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:33.169023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2b88c-67bd-45b3-a0eb-a3d45f1ace96 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.169347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2b88c-67bd-45b3-a0eb-a3d45f1ace96 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.169590 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2b88c-67bd-45b3-a0eb-a3d45f1ace96 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.170965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 279/548] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:00:33.176227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be53c5-4ee1-4db6-ae36-6d2a76a004a5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.176829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be53c5-4ee1-4db6-ae36-6d2a76a004a5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.177323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be53c5-4ee1-4db6-ae36-6d2a76a004a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.204217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-78be53c5-4ee1-4db6-ae36-6d2a76a004a5 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:33.206877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-78be53c5-4ee1-4db6-ae36-6d2a76a004a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:33.269759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d347aa-2055-4c55-990f-03f113c2c7db None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:33.325199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff5ce-2495-466c-ac37-fa0aa2c77793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:33.327749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff5ce-2495-466c-ac37-fa0aa2c77793 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.328041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff5ce-2495-466c-ac37-fa0aa2c77793 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.328319 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff5ce-2495-466c-ac37-fa0aa2c77793 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.336156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 280/549] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:33.350318 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ff5ce-2495-466c-ac37-fa0aa2c77793 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:33.351841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ff5ce-2495-466c-ac37-fa0aa2c77793 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:33.362040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be53c5-4ee1-4db6-ae36-6d2a76a004a5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-db7ff5ce-2495-466c-ac37-fa0aa2c77793 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:33.371555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:33.373300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:33.374392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:33.374392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:33.374392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:33.374392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:33.374392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:33.374392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:33.374392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:33.374392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:33.374392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:00:33.374392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:33.374392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 270/550] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:33.380909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff5ce-2495-466c-ac37-fa0aa2c77793 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:33.412322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:33.492967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:33.550764 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be53c5-4ee1-4db6-ae36-6d2a76a004a5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:33.568469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff5ce-2495-466c-ac37-fa0aa2c77793 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:33.616275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58955463-8bbf-406c-81b2-fd9da0cb4f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:33.617167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58955463-8bbf-406c-81b2-fd9da0cb4f7f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.617452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58955463-8bbf-406c-81b2-fd9da0cb4f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.617731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58955463-8bbf-406c-81b2-fd9da0cb4f7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.626851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0c6bf-b2bc-4d71-a33e-0374f3d999e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:33.627469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0c6bf-b2bc-4d71-a33e-0374f3d999e0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.627759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0c6bf-b2bc-4d71-a33e-0374f3d999e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.628040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0c6bf-b2bc-4d71-a33e-0374f3d999e0 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.628920 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0c6bf-b2bc-4d71-a33e-0374f3d999e0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:33.629237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0c6bf-b2bc-4d71-a33e-0374f3d999e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:33.631123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0c6bf-b2bc-4d71-a33e-0374f3d999e0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:33.646302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58955463-8bbf-406c-81b2-fd9da0cb4f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-58955463-8bbf-406c-81b2-fd9da0cb4f7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:33.654773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:33.655689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:33.656741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 281/551] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:33.665365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58955463-8bbf-406c-81b2-fd9da0cb4f7f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:33.682429 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 271/552] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jun 20 06:00:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:33.690304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0c6bf-b2bc-4d71-a33e-0374f3d999e0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:33.843281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:33.873752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58955463-8bbf-406c-81b2-fd9da0cb4f7f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:33.877676 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0c6bf-b2bc-4d71-a33e-0374f3d999e0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:33.894733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:33.916564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7653c-e089-4b95-92a9-74259e051a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:33.917413 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b51521-94b2-4ea4-b935-1dbde739194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:33.917710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7653c-e089-4b95-92a9-74259e051a5e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.918141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7653c-e089-4b95-92a9-74259e051a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.918383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51521-94b2-4ea4-b935-1dbde739194c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.918750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7653c-e089-4b95-92a9-74259e051a5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.918861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51521-94b2-4ea4-b935-1dbde739194c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.919203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51521-94b2-4ea4-b935-1dbde739194c None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.920057 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b51521-94b2-4ea4-b935-1dbde739194c None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:33.920452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b51521-94b2-4ea4-b935-1dbde739194c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:33.921971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b51521-94b2-4ea4-b935-1dbde739194c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:33.932982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 282/553] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:33.938677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab16299-2a67-4c62-b6fe-9616af326276 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.938979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab16299-2a67-4c62-b6fe-9616af326276 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.939263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab16299-2a67-4c62-b6fe-9616af326276 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.940704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 283/554] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:33.944306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab16299-2a67-4c62-b6fe-9616af326276 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:34.004507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7653c-e089-4b95-92a9-74259e051a5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:34.006685 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7653c-e089-4b95-92a9-74259e051a5e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:34.081856 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab16299-2a67-4c62-b6fe-9616af326276 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:34.118458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 272/555] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 06:00:34.118458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd9ff-19f0-4801-a0be-f54024e27809 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.118458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd9ff-19f0-4801-a0be-f54024e27809 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.118458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd9ff-19f0-4801-a0be-f54024e27809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.129614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046643b4-ad94-40f6-906c-ee8aa86cf2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:34.130741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046643b4-ad94-40f6-906c-ee8aa86cf2da None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.131249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046643b4-ad94-40f6-906c-ee8aa86cf2da None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.131741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046643b4-ad94-40f6-906c-ee8aa86cf2da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.132967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8d8cd9ff-19f0-4801-a0be-f54024e27809 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:34.134305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8d8cd9ff-19f0-4801-a0be-f54024e27809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:34.145090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046643b4-ad94-40f6-906c-ee8aa86cf2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:34.146723 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:34.148143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046643b4-ad94-40f6-906c-ee8aa86cf2da None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:34.158502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-046643b4-ad94-40f6-906c-ee8aa86cf2da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:34.171242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:34.172216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:34.173128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:34.173128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:34.173128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:34.173128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:34.177658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 284/556] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:34.178411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046643b4-ad94-40f6-906c-ee8aa86cf2da None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:34.220940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 273/557] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:34.222303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cd9ff-19f0-4801-a0be-f54024e27809 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:34.285324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046643b4-ad94-40f6-906c-ee8aa86cf2da None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:34.323124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdc905-1ede-4ade-9e86-6769f478435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:34.323926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdc905-1ede-4ade-9e86-6769f478435a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.324227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdc905-1ede-4ade-9e86-6769f478435a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.324491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdc905-1ede-4ade-9e86-6769f478435a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.335643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdc905-1ede-4ade-9e86-6769f478435a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:34.337147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdc905-1ede-4ade-9e86-6769f478435a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:34.341028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cd9ff-19f0-4801-a0be-f54024e27809 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-20fdc905-1ede-4ade-9e86-6769f478435a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:34.355891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:34.357341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:34.358250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:34.358250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:34.358250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:34.358250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:34.358250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 285/558] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:34.358730 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fec84-dbcd-48d0-a868-fcfb236b28df None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.359021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fec84-dbcd-48d0-a868-fcfb236b28df None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.359301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fec84-dbcd-48d0-a868-fcfb236b28df None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.365042 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 286/559] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:34.365042 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fec84-dbcd-48d0-a868-fcfb236b28df None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:34.385384 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf3b72-bb77-4687-ade5-9c4f028159c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:34.385996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf3b72-bb77-4687-ade5-9c4f028159c3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.386468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf3b72-bb77-4687-ade5-9c4f028159c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.386577 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf3b72-bb77-4687-ade5-9c4f028159c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.387259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf3b72-bb77-4687-ade5-9c4f028159c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:34.387571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf3b72-bb77-4687-ade5-9c4f028159c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:34.389373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf3b72-bb77-4687-ade5-9c4f028159c3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:34.401929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 274/560] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:34.402584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf3b72-bb77-4687-ade5-9c4f028159c3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:34.412276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:34.424975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:34.479956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fec84-dbcd-48d0-a868-fcfb236b28df None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:34.513126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf3b72-bb77-4687-ade5-9c4f028159c3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:34.517630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c81ac-6aa8-4b77-b94c-cb6ece83ebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:34.518436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c81ac-6aa8-4b77-b94c-cb6ece83ebff None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.518724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c81ac-6aa8-4b77-b94c-cb6ece83ebff None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.519005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c81ac-6aa8-4b77-b94c-cb6ece83ebff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.530142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c81ac-6aa8-4b77-b94c-cb6ece83ebff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b65c81ac-6aa8-4b77-b94c-cb6ece83ebff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:34.538779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:34.539861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:34.540785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:34.544778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 287/561] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:34.545973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10759bf4-d6bc-4c24-b2c9-0403c1020c29 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.546266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10759bf4-d6bc-4c24-b2c9-0403c1020c29 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.546552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10759bf4-d6bc-4c24-b2c9-0403c1020c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.553716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000cc2b-dfe3-4c9b-a778-d0c31ecb36fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:34.554387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000cc2b-dfe3-4c9b-a778-d0c31ecb36fa None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.554673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000cc2b-dfe3-4c9b-a778-d0c31ecb36fa None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.554950 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000cc2b-dfe3-4c9b-a778-d0c31ecb36fa None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.555679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000cc2b-dfe3-4c9b-a778-d0c31ecb36fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:34.555990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000cc2b-dfe3-4c9b-a778-d0c31ecb36fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:34.557406 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000cc2b-dfe3-4c9b-a778-d0c31ecb36fa None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:34.565633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-10759bf4-d6bc-4c24-b2c9-0403c1020c29 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:34.566909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-10759bf4-d6bc-4c24-b2c9-0403c1020c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:34.579516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 275/562] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:34.580381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000cc2b-dfe3-4c9b-a778-d0c31ecb36fa None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:34.652715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 288/563] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:34.652715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10759bf4-d6bc-4c24-b2c9-0403c1020c29 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:34.662874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:34.699375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:34.703689 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000cc2b-dfe3-4c9b-a778-d0c31ecb36fa None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:34.744977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1d571-6820-495d-9102-c776cf52ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:34.745772 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d571-6820-495d-9102-c776cf52ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.746056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d571-6820-495d-9102-c776cf52ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.746329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d571-6820-495d-9102-c776cf52ebe9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.753759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1d571-6820-495d-9102-c776cf52ebe9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:34.755955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1d571-6820-495d-9102-c776cf52ebe9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:34.761705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10759bf4-d6bc-4c24-b2c9-0403c1020c29 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-00d1d571-6820-495d-9102-c776cf52ebe9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:34.771016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:34.771996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:34.773012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:34.773012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:34.773012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:34.773012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:34.773012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:34.773012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:34.773012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:34.773012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:34.773012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:34.773012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:34.773012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 276/564] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jun 20 06:00:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:34.773617 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1d571-6820-495d-9102-c776cf52ebe9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:34.802088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0f9d4-3f13-4edd-9dba-11244a029348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:34.802761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0f9d4-3f13-4edd-9dba-11244a029348 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.803047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0f9d4-3f13-4edd-9dba-11244a029348 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.803322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0f9d4-3f13-4edd-9dba-11244a029348 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.804067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0f9d4-3f13-4edd-9dba-11244a029348 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:34.804378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0f9d4-3f13-4edd-9dba-11244a029348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:34.805807 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0f9d4-3f13-4edd-9dba-11244a029348 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:34.813648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 289/565] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:34.814588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0f9d4-3f13-4edd-9dba-11244a029348 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:34.874476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1d571-6820-495d-9102-c776cf52ebe9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:34.900573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:34.910210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce064247-4ad7-46b7-9c63-68096e79623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:34.910978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce064247-4ad7-46b7-9c63-68096e79623c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.911268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce064247-4ad7-46b7-9c63-68096e79623c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.911547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce064247-4ad7-46b7-9c63-68096e79623c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.914267 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0f9d4-3f13-4edd-9dba-11244a029348 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:34.915785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:34.918379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce064247-4ad7-46b7-9c63-68096e79623c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:34.919838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce064247-4ad7-46b7-9c63-68096e79623c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ce064247-4ad7-46b7-9c63-68096e79623c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:34.934462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:34.935371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:34.936265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:34.936265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:34.936265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:34.936265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:34.936265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:34.936265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:34.936265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:34.936265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:34.936265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 277/566] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:34.936787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce064247-4ad7-46b7-9c63-68096e79623c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:34.954975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ab69b-2502-4a07-a2bb-c7ce96d8c250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:34.955802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab69b-2502-4a07-a2bb-c7ce96d8c250 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.956085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab69b-2502-4a07-a2bb-c7ce96d8c250 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.956361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab69b-2502-4a07-a2bb-c7ce96d8c250 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.966560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ab69b-2502-4a07-a2bb-c7ce96d8c250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-5d7ab69b-2502-4a07-a2bb-c7ce96d8c250 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:34.974926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:34.976069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:34.977064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 290/567] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:34.978014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220690bc-f718-43c7-9598-9f1c54c9f72c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:34.978014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220690bc-f718-43c7-9598-9f1c54c9f72c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:34.978318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220690bc-f718-43c7-9598-9f1c54c9f72c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:34.983598 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 291/568] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:34.983598 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220690bc-f718-43c7-9598-9f1c54c9f72c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:35.036849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce064247-4ad7-46b7-9c63-68096e79623c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.070407 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcfa1-b637-48ae-8e54-ddd294eadd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:35.071069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcfa1-b637-48ae-8e54-ddd294eadd1a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.071363 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcfa1-b637-48ae-8e54-ddd294eadd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.071640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcfa1-b637-48ae-8e54-ddd294eadd1a None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.072476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fcfa1-b637-48ae-8e54-ddd294eadd1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:35.072819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fcfa1-b637-48ae-8e54-ddd294eadd1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:35.074269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fcfa1-b637-48ae-8e54-ddd294eadd1a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:35.081314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220690bc-f718-43c7-9598-9f1c54c9f72c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.091621 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 278/569] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jun 20 06:00:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:35.092432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcfa1-b637-48ae-8e54-ddd294eadd1a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:35.115116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4277e30-24a4-4ab2-839a-d2f52d3ed9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:35.115910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4277e30-24a4-4ab2-839a-d2f52d3ed9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.116194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4277e30-24a4-4ab2-839a-d2f52d3ed9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.116467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4277e30-24a4-4ab2-839a-d2f52d3ed9e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.127239 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4277e30-24a4-4ab2-839a-d2f52d3ed9e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:35.128762 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4277e30-24a4-4ab2-839a-d2f52d3ed9e7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:35.139138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f4277e30-24a4-4ab2-839a-d2f52d3ed9e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:35.147447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:35.148494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:35.149459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:35.149459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:35.149459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:35.149459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:35.149459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 292/570] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:35.149842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4277e30-24a4-4ab2-839a-d2f52d3ed9e7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:35.165790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:35.197489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcfa1-b637-48ae-8e54-ddd294eadd1a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.230876 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ad2f0-3e36-450c-887b-177bc08a712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:35.231535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ad2f0-3e36-450c-887b-177bc08a712a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.231825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ad2f0-3e36-450c-887b-177bc08a712a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.232099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ad2f0-3e36-450c-887b-177bc08a712a None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.232920 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ad2f0-3e36-450c-887b-177bc08a712a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:35.233230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ad2f0-3e36-450c-887b-177bc08a712a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:35.234671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ad2f0-3e36-450c-887b-177bc08a712a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:35.246649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 279/571] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:35.247697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e7337-e171-4ed8-90d1-a0cad1eb8763 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.247987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e7337-e171-4ed8-90d1-a0cad1eb8763 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.248268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e7337-e171-4ed8-90d1-a0cad1eb8763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.253573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4277e30-24a4-4ab2-839a-d2f52d3ed9e7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.264175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-476e7337-e171-4ed8-90d1-a0cad1eb8763 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:35.265391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-476e7337-e171-4ed8-90d1-a0cad1eb8763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:35.287898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0e318-b87c-4624-81ca-157c7fed9491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:35.288582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0e318-b87c-4624-81ca-157c7fed9491 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.288906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0e318-b87c-4624-81ca-157c7fed9491 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.289192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0e318-b87c-4624-81ca-157c7fed9491 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.289996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0e318-b87c-4624-81ca-157c7fed9491 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:35.290311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0e318-b87c-4624-81ca-157c7fed9491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:35.291688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0e318-b87c-4624-81ca-157c7fed9491 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:35.299563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 293/572] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:35.300419 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0e318-b87c-4624-81ca-157c7fed9491 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:35.336951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 280/573] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:35.338053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e7337-e171-4ed8-90d1-a0cad1eb8763 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:35.374287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:35.382395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:35.405688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0e318-b87c-4624-81ca-157c7fed9491 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.439671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30486b-0b26-4ac9-a40f-65693c73cde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:35.440392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30486b-0b26-4ac9-a40f-65693c73cde6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.440709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30486b-0b26-4ac9-a40f-65693c73cde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.440808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e7337-e171-4ed8-90d1-a0cad1eb8763 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.441237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30486b-0b26-4ac9-a40f-65693c73cde6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.452105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30486b-0b26-4ac9-a40f-65693c73cde6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:35.453589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30486b-0b26-4ac9-a40f-65693c73cde6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-7c30486b-0b26-4ac9-a40f-65693c73cde6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:35.470393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:35.471324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:35.472286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:35.472286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:35.472286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:35.472286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:35.473227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 294/574] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:35.474376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30486b-0b26-4ac9-a40f-65693c73cde6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:35.475252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b793d26-dd8f-4c30-85a8-5149a157d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:35.476022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b793d26-dd8f-4c30-85a8-5149a157d941 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.476372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b793d26-dd8f-4c30-85a8-5149a157d941 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.476688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b793d26-dd8f-4c30-85a8-5149a157d941 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.477422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b793d26-dd8f-4c30-85a8-5149a157d941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:35.477743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b793d26-dd8f-4c30-85a8-5149a157d941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:35.479132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b793d26-dd8f-4c30-85a8-5149a157d941 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:35.491486 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 281/575] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:35.492067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b793d26-dd8f-4c30-85a8-5149a157d941 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:35.575731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30486b-0b26-4ac9-a40f-65693c73cde6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.585744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:35.592738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b793d26-dd8f-4c30-85a8-5149a157d941 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.602061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:35.610332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcc85-06a0-43fd-ac7f-a88980d7a37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:35.610984 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcc85-06a0-43fd-ac7f-a88980d7a37b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.611272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcc85-06a0-43fd-ac7f-a88980d7a37b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.611552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcc85-06a0-43fd-ac7f-a88980d7a37b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.612385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffcc85-06a0-43fd-ac7f-a88980d7a37b None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=0aadba0174824781b1866da7ba39956e) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:35.612735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffcc85-06a0-43fd-ac7f-a88980d7a37b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:35.614727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffcc85-06a0-43fd-ac7f-a88980d7a37b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:35.620143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 295/576] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:35 2022] GET /identity/v3/role_assignments?user.id=0aadba0174824781b1866da7ba39956e&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:35.620984 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcc85-06a0-43fd-ac7f-a88980d7a37b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:35.636068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a72bb-77a3-4fb4-9f25-b8da29152624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:35.636926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a72bb-77a3-4fb4-9f25-b8da29152624 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.637215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a72bb-77a3-4fb4-9f25-b8da29152624 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.637494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a72bb-77a3-4fb4-9f25-b8da29152624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.651670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a72bb-77a3-4fb4-9f25-b8da29152624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:35.653238 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a72bb-77a3-4fb4-9f25-b8da29152624 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-4b5a72bb-77a3-4fb4-9f25-b8da29152624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:35.672397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:35.673451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:35.674366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:35.674366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:35.674366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:35.674366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:35.679356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 282/577] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:35.680361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a72bb-77a3-4fb4-9f25-b8da29152624 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:35.753709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcc85-06a0-43fd-ac7f-a88980d7a37b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.791586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f92e9-b815-4db5-a562-aa6be81dabd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:35.792394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f92e9-b815-4db5-a562-aa6be81dabd3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.792779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f92e9-b815-4db5-a562-aa6be81dabd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.793064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f92e9-b815-4db5-a562-aa6be81dabd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.797275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a72bb-77a3-4fb4-9f25-b8da29152624 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.804427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f92e9-b815-4db5-a562-aa6be81dabd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-785f92e9-b815-4db5-a562-aa6be81dabd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:35.812207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:35.813243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:35.814099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 296/578] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:35.814806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f92e9-b815-4db5-a562-aa6be81dabd3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:35.839893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223071f-7bd9-4be7-92e8-51c951b73f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:35.840557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223071f-7bd9-4be7-92e8-51c951b73f72 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.840893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223071f-7bd9-4be7-92e8-51c951b73f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.841172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223071f-7bd9-4be7-92e8-51c951b73f72 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.841895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223071f-7bd9-4be7-92e8-51c951b73f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:35.842207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223071f-7bd9-4be7-92e8-51c951b73f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:35.843609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223071f-7bd9-4be7-92e8-51c951b73f72 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:35.856671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 283/579] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:35.857386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223071f-7bd9-4be7-92e8-51c951b73f72 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:35.867919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:35.877490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:35.941890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f92e9-b815-4db5-a562-aa6be81dabd3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.969791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223071f-7bd9-4be7-92e8-51c951b73f72 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:35.981856 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354b362-85e6-4663-aaac-79d1e3d4d241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:35.982657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b362-85e6-4663-aaac-79d1e3d4d241 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:35.982945 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b362-85e6-4663-aaac-79d1e3d4d241 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:35.983222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354b362-85e6-4663-aaac-79d1e3d4d241 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:35.991857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354b362-85e6-4663-aaac-79d1e3d4d241 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:35.993456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354b362-85e6-4663-aaac-79d1e3d4d241 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.004301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794c050-ecba-4cdd-b159-aa597cf8b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:36.005560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794c050-ecba-4cdd-b159-aa597cf8b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:36.006009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794c050-ecba-4cdd-b159-aa597cf8b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:36.006272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794c050-ecba-4cdd-b159-aa597cf8b6d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:36.006994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794c050-ecba-4cdd-b159-aa597cf8b6d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:36.007303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794c050-ecba-4cdd-b159-aa597cf8b6d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-3354b362-85e6-4663-aaac-79d1e3d4d241 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:36.008337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:36.009410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:36.015220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:36.015220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:36.015220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:36.015220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:36.015220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:36.015220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:36.015220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:36.015220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:36.015220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 06:00:36.015220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:36.015961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794c050-ecba-4cdd-b159-aa597cf8b6d5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.016062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 297/580] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:36.016062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354b362-85e6-4663-aaac-79d1e3d4d241 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:36.027955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 284/581] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:36.029402 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794c050-ecba-4cdd-b159-aa597cf8b6d5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:36.102749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:36.126631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354b362-85e6-4663-aaac-79d1e3d4d241 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:36.140197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794c050-ecba-4cdd-b159-aa597cf8b6d5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:36.144943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:36.171563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8acf04-e903-4ec9-b3b6-a11881eca6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:36.172238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8acf04-e903-4ec9-b3b6-a11881eca6af None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:36.172520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8acf04-e903-4ec9-b3b6-a11881eca6af None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:36.172826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8acf04-e903-4ec9-b3b6-a11881eca6af None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:36.173576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8acf04-e903-4ec9-b3b6-a11881eca6af None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:36.173888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8acf04-e903-4ec9-b3b6-a11881eca6af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:36.175304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8acf04-e903-4ec9-b3b6-a11881eca6af None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.175921 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501240f8-2169-4aa6-bee6-5a5358900109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:36.177256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501240f8-2169-4aa6-bee6-5a5358900109 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:36.177545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501240f8-2169-4aa6-bee6-5a5358900109 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:36.177824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501240f8-2169-4aa6-bee6-5a5358900109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:36.188755 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 298/582] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:36.188903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501240f8-2169-4aa6-bee6-5a5358900109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:36.188984 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8acf04-e903-4ec9-b3b6-a11881eca6af None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:36.189056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501240f8-2169-4aa6-bee6-5a5358900109 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-501240f8-2169-4aa6-bee6-5a5358900109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:36.205039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:36.205944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:36.206846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:36.206846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:36.206846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:36.206846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:36.206846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:36.206846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:36.206846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:36.206846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:36.206846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 285/583] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:36.207350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501240f8-2169-4aa6-bee6-5a5358900109 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:36.305935 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8acf04-e903-4ec9-b3b6-a11881eca6af None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:36.314981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501240f8-2169-4aa6-bee6-5a5358900109 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:36.342094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1085bc0-5f24-42d3-851c-e2588cef3b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:36.343094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1085bc0-5f24-42d3-851c-e2588cef3b08 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:36.343303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:36.343796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1085bc0-5f24-42d3-851c-e2588cef3b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:36.344266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1085bc0-5f24-42d3-851c-e2588cef3b08 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:36.345636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1085bc0-5f24-42d3-851c-e2588cef3b08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:36.345994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1085bc0-5f24-42d3-851c-e2588cef3b08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:36.347506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1085bc0-5f24-42d3-851c-e2588cef3b08 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.354746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9273c-6999-463b-9c88-233661ee59f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:36.355578 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9273c-6999-463b-9c88-233661ee59f6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:36.355865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9273c-6999-463b-9c88-233661ee59f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:36.356139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9273c-6999-463b-9c88-233661ee59f6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:36.363505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9273c-6999-463b-9c88-233661ee59f6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:36.365608 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9273c-6999-463b-9c88-233661ee59f6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.371506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 299/584] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jun 20 06:00:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:36.371506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1085bc0-5f24-42d3-851c-e2588cef3b08 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-95c9273c-6999-463b-9c88-233661ee59f6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:36.380634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:36.381567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 286/585] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:36.387643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9273c-6999-463b-9c88-233661ee59f6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:36.412717 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:36.485411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1085bc0-5f24-42d3-851c-e2588cef3b08 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:36.496837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9273c-6999-463b-9c88-233661ee59f6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:36.519914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19ab4-68a1-4a42-9855-f6d3be552a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:36.521514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19ab4-68a1-4a42-9855-f6d3be552a51 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:36.521985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19ab4-68a1-4a42-9855-f6d3be552a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:36.522470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19ab4-68a1-4a42-9855-f6d3be552a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:36.532541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d19ab4-68a1-4a42-9855-f6d3be552a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:36.534428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d19ab4-68a1-4a42-9855-f6d3be552a51 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.534945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd10683-a767-4c93-a62a-1fd02624d306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:36.535618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd10683-a767-4c93-a62a-1fd02624d306 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:36.535957 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd10683-a767-4c93-a62a-1fd02624d306 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:36.536775 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd10683-a767-4c93-a62a-1fd02624d306 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:36.537749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd10683-a767-4c93-a62a-1fd02624d306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:36.538342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd10683-a767-4c93-a62a-1fd02624d306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:36.539780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd10683-a767-4c93-a62a-1fd02624d306 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.552788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 287/586] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:36.553586 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd10683-a767-4c93-a62a-1fd02624d306 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-11d19ab4-68a1-4a42-9855-f6d3be552a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:36.553855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:36.554706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:36.555605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:36.555605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:36.555605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:36.555605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:36.557170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 300/587] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:36.558071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19ab4-68a1-4a42-9855-f6d3be552a51 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:36.610661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:36.655440 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:36.672745 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19ab4-68a1-4a42-9855-f6d3be552a51 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:36.675664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd10683-a767-4c93-a62a-1fd02624d306 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:36.710009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011588-40e9-462b-bc1d-2bd29e2047f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:36.710688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011588-40e9-462b-bc1d-2bd29e2047f7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:36.710975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011588-40e9-462b-bc1d-2bd29e2047f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:36.711254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011588-40e9-462b-bc1d-2bd29e2047f7 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:36.712062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1277778-aded-438f-a166-e93f81d56f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:36.712175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37011588-40e9-462b-bc1d-2bd29e2047f7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:36.712411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37011588-40e9-462b-bc1d-2bd29e2047f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:36.712882 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1277778-aded-438f-a166-e93f81d56f16 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:36.713173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1277778-aded-438f-a166-e93f81d56f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:36.713456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1277778-aded-438f-a166-e93f81d56f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:36.713883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37011588-40e9-462b-bc1d-2bd29e2047f7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.727878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1277778-aded-438f-a166-e93f81d56f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:36.729454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1277778-aded-438f-a166-e93f81d56f16 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.733877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 301/588] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jun 20 06:00:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:36.737925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011588-40e9-462b-bc1d-2bd29e2047f7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f1277778-aded-438f-a166-e93f81d56f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:36.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:36.749573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:36.750558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:36.750558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:36.750558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:36.750558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:36.750558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 288/589] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:36.750843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1277778-aded-438f-a166-e93f81d56f16 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:36.842227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011588-40e9-462b-bc1d-2bd29e2047f7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:36.862595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:36.868356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1277778-aded-438f-a166-e93f81d56f16 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:36.877113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635c72b-8104-4fc3-99dc-c043c9cfd571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:36.878005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635c72b-8104-4fc3-99dc-c043c9cfd571 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:36.878290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635c72b-8104-4fc3-99dc-c043c9cfd571 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:36.878571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635c72b-8104-4fc3-99dc-c043c9cfd571 None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/3748d8369d20429eb2376ce02d42eee0/roles/acb584c0cfb34695a7cd4ba39aabb279` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:36.890278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:36.893387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635c72b-8104-4fc3-99dc-c043c9cfd571 None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=3748d8369d20429eb2376ce02d42eee0, role_id=acb584c0cfb34695a7cd4ba39aabb279)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:36.895903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635c72b-8104-4fc3-99dc-c043c9cfd571 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.916639 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 302/590] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:00:36 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/3748d8369d20429eb2376ce02d42eee0/roles/acb584c0cfb34695a7cd4ba39aabb279 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:36.916639 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635c72b-8104-4fc3-99dc-c043c9cfd571 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:36.918075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51278695-e65c-43d2-bcb3-d0b69efb373c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:36.918883 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51278695-e65c-43d2-bcb3-d0b69efb373c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:36.919287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51278695-e65c-43d2-bcb3-d0b69efb373c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:36.919802 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51278695-e65c-43d2-bcb3-d0b69efb373c None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:36.920840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51278695-e65c-43d2-bcb3-d0b69efb373c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:36.921266 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51278695-e65c-43d2-bcb3-d0b69efb373c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:36.922796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51278695-e65c-43d2-bcb3-d0b69efb373c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:36.943083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 289/591] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:36.943083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51278695-e65c-43d2-bcb3-d0b69efb373c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:37.046549 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635c72b-8104-4fc3-99dc-c043c9cfd571 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:37.080058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51278695-e65c-43d2-bcb3-d0b69efb373c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:37.095174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621b60e-4772-4f8a-81a2-bf2b73a5ee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:37.095913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621b60e-4772-4f8a-81a2-bf2b73a5ee33 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.096206 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621b60e-4772-4f8a-81a2-bf2b73a5ee33 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.096492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621b60e-4772-4f8a-81a2-bf2b73a5ee33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.108825 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621b60e-4772-4f8a-81a2-bf2b73a5ee33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:37.110333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621b60e-4772-4f8a-81a2-bf2b73a5ee33 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:37.120743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57accb-3260-4d4b-acb2-3758a1b5b791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:37.121398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57accb-3260-4d4b-acb2-3758a1b5b791 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.121686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57accb-3260-4d4b-acb2-3758a1b5b791 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.123020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57accb-3260-4d4b-acb2-3758a1b5b791 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.123020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57accb-3260-4d4b-acb2-3758a1b5b791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:37.123202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57accb-3260-4d4b-acb2-3758a1b5b791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:37.124497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57accb-3260-4d4b-acb2-3758a1b5b791 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6621b60e-4772-4f8a-81a2-bf2b73a5ee33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:37.131210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:37.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:37.133173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:37.133173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:37.133173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:37.133173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:37.133885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 303/592] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:37.134783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621b60e-4772-4f8a-81a2-bf2b73a5ee33 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:37.138371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 290/593] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:37.139554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57accb-3260-4d4b-acb2-3758a1b5b791 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:37.161646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:37.212984 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:37.251529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57accb-3260-4d4b-acb2-3758a1b5b791 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:37.258294 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621b60e-4772-4f8a-81a2-bf2b73a5ee33 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:37.289598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76d7d9-c661-4ba5-a9a0-657e3bebfe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:37.290581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76d7d9-c661-4ba5-a9a0-657e3bebfe57 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.291136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76d7d9-c661-4ba5-a9a0-657e3bebfe57 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.291626 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76d7d9-c661-4ba5-a9a0-657e3bebfe57 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.292585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76d7d9-c661-4ba5-a9a0-657e3bebfe57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:37.293101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76d7d9-c661-4ba5-a9a0-657e3bebfe57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:37.294776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76d7d9-c661-4ba5-a9a0-657e3bebfe57 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:37.303335 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56497d24-fbc8-4c5d-bb0c-546b0f1a4c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:37.304199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56497d24-fbc8-4c5d-bb0c-546b0f1a4c2a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.304690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56497d24-fbc8-4c5d-bb0c-546b0f1a4c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.305094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56497d24-fbc8-4c5d-bb0c-546b0f1a4c2a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.310024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 291/594] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:37.311128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76d7d9-c661-4ba5-a9a0-657e3bebfe57 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:37.321925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56497d24-fbc8-4c5d-bb0c-546b0f1a4c2a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:37.323690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56497d24-fbc8-4c5d-bb0c-546b0f1a4c2a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-56497d24-fbc8-4c5d-bb0c-546b0f1a4c2a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:37.342541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:37.343589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:37.344540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:37.344540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:37.344540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:37.344540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:37.344540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:37.344540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:37.344540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:37.344540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:37.344540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 06:00:37.344540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:37.344540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 304/595] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:37.347324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56497d24-fbc8-4c5d-bb0c-546b0f1a4c2a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:37.432978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:37.461417 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76d7d9-c661-4ba5-a9a0-657e3bebfe57 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:37.484767 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56497d24-fbc8-4c5d-bb0c-546b0f1a4c2a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:37.488260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:37.499544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f2d7-b1de-48f2-8e13-1325f6c0b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:37.500642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f2d7-b1de-48f2-8e13-1325f6c0b6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.500642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f2d7-b1de-48f2-8e13-1325f6c0b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.500917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f2d7-b1de-48f2-8e13-1325f6c0b6b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.508367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8f2d7-b1de-48f2-8e13-1325f6c0b6b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:37.509873 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8f2d7-b1de-48f2-8e13-1325f6c0b6b5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-43a8f2d7-b1de-48f2-8e13-1325f6c0b6b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:37.524247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:37.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:37.526766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:37.526766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:37.526766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:37.526766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:37.526766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:37.526766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:37.526766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:37.526766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:37.526766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 292/596] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:37.526766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f2d7-b1de-48f2-8e13-1325f6c0b6b5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:37.538836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f7af6-0224-4f3d-89ed-dd66d6e52cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:37.539583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f7af6-0224-4f3d-89ed-dd66d6e52cea None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.539868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f7af6-0224-4f3d-89ed-dd66d6e52cea None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.540148 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f7af6-0224-4f3d-89ed-dd66d6e52cea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.548451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f7af6-0224-4f3d-89ed-dd66d6e52cea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:37.550069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f7af6-0224-4f3d-89ed-dd66d6e52cea None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-164f7af6-0224-4f3d-89ed-dd66d6e52cea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:37.564857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:37.565795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:37.566715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:37.566715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:37.566715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:37.566715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:37.566715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:37.566715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:37.566715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:37.566715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:37.570812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 305/597] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:37.571688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f7af6-0224-4f3d-89ed-dd66d6e52cea None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:37.652419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f2d7-b1de-48f2-8e13-1325f6c0b6b5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:37.697699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d7d17-ebe9-483f-b511-9a7a5fc0ba09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:37.698373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7d17-ebe9-483f-b511-9a7a5fc0ba09 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.698655 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7d17-ebe9-483f-b511-9a7a5fc0ba09 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.698930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7d17-ebe9-483f-b511-9a7a5fc0ba09 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.699598 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f7af6-0224-4f3d-89ed-dd66d6e52cea None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:37.699760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d7d17-ebe9-483f-b511-9a7a5fc0ba09 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:37.700066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d7d17-ebe9-483f-b511-9a7a5fc0ba09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:37.701570 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d7d17-ebe9-483f-b511-9a7a5fc0ba09 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:37.711033 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:37.724539 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 293/598] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Jun 20 06:00:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:37.725581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d7d17-ebe9-483f-b511-9a7a5fc0ba09 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:37.738220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3415601-3c1e-483d-8b43-2195e02e2368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:37.739638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3415601-3c1e-483d-8b43-2195e02e2368 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.739944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3415601-3c1e-483d-8b43-2195e02e2368 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.740197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3415601-3c1e-483d-8b43-2195e02e2368 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.741039 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3415601-3c1e-483d-8b43-2195e02e2368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:37.741359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3415601-3c1e-483d-8b43-2195e02e2368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:37.742819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3415601-3c1e-483d-8b43-2195e02e2368 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:37.766541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 306/599] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:37.766541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49632c1-d54c-4413-8a26-cef048cc0b63 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.766541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49632c1-d54c-4413-8a26-cef048cc0b63 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.766541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49632c1-d54c-4413-8a26-cef048cc0b63 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.766541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 307/600] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:37.766541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49632c1-d54c-4413-8a26-cef048cc0b63 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:37.794493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:37.843963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d7d17-ebe9-483f-b511-9a7a5fc0ba09 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:37.880737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29930-1c7a-4aef-9e28-84bb27f4bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:37.881327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29930-1c7a-4aef-9e28-84bb27f4bb8e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.881611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29930-1c7a-4aef-9e28-84bb27f4bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.881889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29930-1c7a-4aef-9e28-84bb27f4bb8e None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.882653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49632c1-d54c-4413-8a26-cef048cc0b63 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:37.883085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e29930-1c7a-4aef-9e28-84bb27f4bb8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:37.883085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e29930-1c7a-4aef-9e28-84bb27f4bb8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:37.884373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e29930-1c7a-4aef-9e28-84bb27f4bb8e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:37.897171 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 294/601] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:37.897776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29930-1c7a-4aef-9e28-84bb27f4bb8e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:37.925051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabba95e-d376-4a08-b2b8-73d3d3d34cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:37.925889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabba95e-d376-4a08-b2b8-73d3d3d34cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.926180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabba95e-d376-4a08-b2b8-73d3d3d34cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.926526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabba95e-d376-4a08-b2b8-73d3d3d34cb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.937097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabba95e-d376-4a08-b2b8-73d3d3d34cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:37.938555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabba95e-d376-4a08-b2b8-73d3d3d34cb0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-aabba95e-d376-4a08-b2b8-73d3d3d34cb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:37.956973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:37.958671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:37.959586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:37.959586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:37.959586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:37.959586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:37.959586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 308/602] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:37.960096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:37.960444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9bc3-7edb-4252-83c8-4db9733dc407 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:37.960981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9bc3-7edb-4252-83c8-4db9733dc407 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:37.961093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9bc3-7edb-4252-83c8-4db9733dc407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:37.977665 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-223d9bc3-7edb-4252-83c8-4db9733dc407 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:37.978864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-223d9bc3-7edb-4252-83c8-4db9733dc407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:38.015782 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29930-1c7a-4aef-9e28-84bb27f4bb8e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:38.050476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 309/603] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:38.051590 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d9bc3-7edb-4252-83c8-4db9733dc407 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:38.069287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:38.075629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac544f-b44a-423f-adb4-4762c049fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:38.076653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac544f-b44a-423f-adb4-4762c049fe42 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:38.076842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac544f-b44a-423f-adb4-4762c049fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:38.077131 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac544f-b44a-423f-adb4-4762c049fe42 None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/3780488ee9404b3b8eda52acf8dceca3/roles/acb584c0cfb34695a7cd4ba39aabb279` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:38.094198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac544f-b44a-423f-adb4-4762c049fe42 None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=3780488ee9404b3b8eda52acf8dceca3, role_id=acb584c0cfb34695a7cd4ba39aabb279)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:38.095647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac544f-b44a-423f-adb4-4762c049fe42 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:38.111452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 295/604] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:00:37 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/3780488ee9404b3b8eda52acf8dceca3/roles/acb584c0cfb34695a7cd4ba39aabb279 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:38.112518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac544f-b44a-423f-adb4-4762c049fe42 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:38.196866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d9bc3-7edb-4252-83c8-4db9733dc407 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:38.250752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9668a9c-d9ff-4aaa-8a5a-7afd37bce9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:38.251925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9668a9c-d9ff-4aaa-8a5a-7afd37bce9f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:38.252212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9668a9c-d9ff-4aaa-8a5a-7afd37bce9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:38.252492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9668a9c-d9ff-4aaa-8a5a-7afd37bce9f8 None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/7071b87350864e478e848e7d3d66e33e/roles/acb584c0cfb34695a7cd4ba39aabb279` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:38.253876 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac544f-b44a-423f-adb4-4762c049fe42 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:38.264907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:38.274035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9668a9c-d9ff-4aaa-8a5a-7afd37bce9f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=7071b87350864e478e848e7d3d66e33e, role_id=acb584c0cfb34695a7cd4ba39aabb279)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:38.275502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9668a9c-d9ff-4aaa-8a5a-7afd37bce9f8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:38.298436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 310/605] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:00:38 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/7071b87350864e478e848e7d3d66e33e/roles/acb584c0cfb34695a7cd4ba39aabb279 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:38.299297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9668a9c-d9ff-4aaa-8a5a-7afd37bce9f8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:38.320527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c910-09aa-4ec9-9e00-b2daa92212a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:38.321698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c910-09aa-4ec9-9e00-b2daa92212a2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:38.322137 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c910-09aa-4ec9-9e00-b2daa92212a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:38.322844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c910-09aa-4ec9-9e00-b2daa92212a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:38.324776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c910-09aa-4ec9-9e00-b2daa92212a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:38.325306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c910-09aa-4ec9-9e00-b2daa92212a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:38.326985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c910-09aa-4ec9-9e00-b2daa92212a2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:38.347820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 296/606] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:38.354015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c910-09aa-4ec9-9e00-b2daa92212a2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:38.381425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:38.436478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9668a9c-d9ff-4aaa-8a5a-7afd37bce9f8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:38.471799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c910-09aa-4ec9-9e00-b2daa92212a2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:38.498608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb71c4-452c-45a5-a20e-e2dd10c121a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:38.499806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb71c4-452c-45a5-a20e-e2dd10c121a5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:38.500258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb71c4-452c-45a5-a20e-e2dd10c121a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:38.500729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb71c4-452c-45a5-a20e-e2dd10c121a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:38.513035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8b1ef-8dea-47f0-95ec-c6f2e8ed9fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:38.514092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8b1ef-8dea-47f0-95ec-c6f2e8ed9fef None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:38.514383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8b1ef-8dea-47f0-95ec-c6f2e8ed9fef None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:38.514759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8b1ef-8dea-47f0-95ec-c6f2e8ed9fef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:38.518952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb71c4-452c-45a5-a20e-e2dd10c121a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:38.522753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8b1ef-8dea-47f0-95ec-c6f2e8ed9fef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:38.524374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8b1ef-8dea-47f0-95ec-c6f2e8ed9fef None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4fbb71c4-452c-45a5-a20e-e2dd10c121a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:38.531283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:38.532444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:38.533608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 311/607] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:38.539102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb71c4-452c-45a5-a20e-e2dd10c121a5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-43f8b1ef-8dea-47f0-95ec-c6f2e8ed9fef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:38.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:38.545841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:38.546969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:38.546969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:38.546969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:38.546969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:38.546969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:38.546969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:38.546969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:38.546969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:38.548763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 297/608] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:38.555347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8b1ef-8dea-47f0-95ec-c6f2e8ed9fef None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:38.601453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:38.698213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb71c4-452c-45a5-a20e-e2dd10c121a5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:38.701683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8b1ef-8dea-47f0-95ec-c6f2e8ed9fef None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:38.732059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:38.761177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6307f-a4d9-43ac-9573-52da89137033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:38.761858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6307f-a4d9-43ac-9573-52da89137033 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:38.762331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6307f-a4d9-43ac-9573-52da89137033 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:38.762618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6307f-a4d9-43ac-9573-52da89137033 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:38.763939 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6307f-a4d9-43ac-9573-52da89137033 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:38.764254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6307f-a4d9-43ac-9573-52da89137033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:38.765679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6307f-a4d9-43ac-9573-52da89137033 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:38.771984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b15b7-340f-4194-9253-60b17f36b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:38.772687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b15b7-340f-4194-9253-60b17f36b31d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:38.772978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b15b7-340f-4194-9253-60b17f36b31d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:38.773257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b15b7-340f-4194-9253-60b17f36b31d None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:38.774051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b15b7-340f-4194-9253-60b17f36b31d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:38.774363 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b15b7-340f-4194-9253-60b17f36b31d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:38.775811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b15b7-340f-4194-9253-60b17f36b31d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:38.786135 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 312/609] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:38.793031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6307f-a4d9-43ac-9573-52da89137033 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:38.799604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 298/610] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:38.805371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b15b7-340f-4194-9253-60b17f36b31d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:38.976239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b15b7-340f-4194-9253-60b17f36b31d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:38.985068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:38.987148 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6307f-a4d9-43ac-9573-52da89137033 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:39.015820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6762a1-4ec8-4031-9aab-c29bfe6b54b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:39.016929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6762a1-4ec8-4031-9aab-c29bfe6b54b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:39.017222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6762a1-4ec8-4031-9aab-c29bfe6b54b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:39.017629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6762a1-4ec8-4031-9aab-c29bfe6b54b5 None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/9d21089ce5b140ab9549816b8cb38316/roles/acb584c0cfb34695a7cd4ba39aabb279` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:39.035523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6762a1-4ec8-4031-9aab-c29bfe6b54b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=9d21089ce5b140ab9549816b8cb38316, role_id=acb584c0cfb34695a7cd4ba39aabb279)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:39.037475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6762a1-4ec8-4031-9aab-c29bfe6b54b5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:39.059787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 299/611] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:00:38 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/9d21089ce5b140ab9549816b8cb38316/roles/acb584c0cfb34695a7cd4ba39aabb279 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:39.069386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2963c3-f0f1-4c61-8d02-541396c42a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:39.070268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2963c3-f0f1-4c61-8d02-541396c42a42 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:39.070559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2963c3-f0f1-4c61-8d02-541396c42a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:39.070838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2963c3-f0f1-4c61-8d02-541396c42a42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:39.083366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2963c3-f0f1-4c61-8d02-541396c42a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:39.084960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2963c3-f0f1-4c61-8d02-541396c42a42 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-8f2963c3-f0f1-4c61-8d02-541396c42a42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:39.105805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:39.107122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:39.108436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:39.108436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:39.108436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:39.108436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:39.108436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 313/612] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:39.113059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6762a1-4ec8-4031-9aab-c29bfe6b54b5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:39.221496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6762a1-4ec8-4031-9aab-c29bfe6b54b5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:39.260223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8e6bb-1ff1-49c2-93df-bd95a4cb8677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:39.261022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e6bb-1ff1-49c2-93df-bd95a4cb8677 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:39.261409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e6bb-1ff1-49c2-93df-bd95a4cb8677 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:39.261788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e6bb-1ff1-49c2-93df-bd95a4cb8677 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:39.262628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8e6bb-1ff1-49c2-93df-bd95a4cb8677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:39.263060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8e6bb-1ff1-49c2-93df-bd95a4cb8677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:39.264563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8e6bb-1ff1-49c2-93df-bd95a4cb8677 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:39.273144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:39.278534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 300/613] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:39.286543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2963c3-f0f1-4c61-8d02-541396c42a42 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:39.338103 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:39.367741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0304b-9530-47f7-a4d3-2d8b9786be39 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:39.368040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0304b-9530-47f7-a4d3-2d8b9786be39 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:39.368333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0304b-9530-47f7-a4d3-2d8b9786be39 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:39.369903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 301/614] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:39.374889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b4711-0ae0-48e2-9994-75c34f5878b3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:39.375174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b4711-0ae0-48e2-9994-75c34f5878b3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:39.375450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b4711-0ae0-48e2-9994-75c34f5878b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:39.395642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-019b4711-0ae0-48e2-9994-75c34f5878b3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:39.397398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-019b4711-0ae0-48e2-9994-75c34f5878b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:39.481227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2963c3-f0f1-4c61-8d02-541396c42a42 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:39.532642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88032700-3cd4-4fbe-ba11-1fb514616df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:39.533372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88032700-3cd4-4fbe-ba11-1fb514616df5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:39.533656 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88032700-3cd4-4fbe-ba11-1fb514616df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:39.533928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88032700-3cd4-4fbe-ba11-1fb514616df5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:39.544164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 302/615] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:39.548047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88032700-3cd4-4fbe-ba11-1fb514616df5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:39.549538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88032700-3cd4-4fbe-ba11-1fb514616df5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-88032700-3cd4-4fbe-ba11-1fb514616df5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:39.564592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:39.565610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:39.566574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:39.566574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:39.566574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:39.566574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:39.566574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:39.566574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:39.566574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:39.566574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:39.566574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:00:39.566574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:39.566574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 314/616] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:39.572798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b4711-0ae0-48e2-9994-75c34f5878b3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:39.586293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88032700-3cd4-4fbe-ba11-1fb514616df5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:39.685637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:39.696413 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88032700-3cd4-4fbe-ba11-1fb514616df5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:39.734224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6dec-2477-4949-945b-f9de5a3d61bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:39.735083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6dec-2477-4949-945b-f9de5a3d61bd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:39.735372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6dec-2477-4949-945b-f9de5a3d61bd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:39.735751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6dec-2477-4949-945b-f9de5a3d61bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:39.747982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b6dec-2477-4949-945b-f9de5a3d61bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6b2b6dec-2477-4949-945b-f9de5a3d61bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:39.757347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:39.758319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:39.759167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 315/617] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:39.764867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6dec-2477-4949-945b-f9de5a3d61bd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:39.789932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b4711-0ae0-48e2-9994-75c34f5878b3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:39.843776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:39.860081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052ce79-8eaf-4969-b468-2e5914d5fd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:39.860799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052ce79-8eaf-4969-b468-2e5914d5fd9a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:39.861093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052ce79-8eaf-4969-b468-2e5914d5fd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:39.861649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052ce79-8eaf-4969-b468-2e5914d5fd9a None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:39.862629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052ce79-8eaf-4969-b468-2e5914d5fd9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:39.863067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052ce79-8eaf-4969-b468-2e5914d5fd9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:39.864839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052ce79-8eaf-4969-b468-2e5914d5fd9a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:39.899223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 303/618] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jun 20 06:00:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:39.906025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052ce79-8eaf-4969-b468-2e5914d5fd9a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:39.920464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6dec-2477-4949-945b-f9de5a3d61bd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:39.960515 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807e4a-2bac-4285-a5f0-4f7b926c432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:39.961838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807e4a-2bac-4285-a5f0-4f7b926c432a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:39.962443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807e4a-2bac-4285-a5f0-4f7b926c432a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:39.963159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807e4a-2bac-4285-a5f0-4f7b926c432a None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:39.964520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c807e4a-2bac-4285-a5f0-4f7b926c432a None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:39.965031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c807e4a-2bac-4285-a5f0-4f7b926c432a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:39.966594 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c807e4a-2bac-4285-a5f0-4f7b926c432a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:39.977476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 316/619] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:39.983302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807e4a-2bac-4285-a5f0-4f7b926c432a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:40.001509 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:40.104329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052ce79-8eaf-4969-b468-2e5914d5fd9a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:40.140326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807e4a-2bac-4285-a5f0-4f7b926c432a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:40.141935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ea4fa-e94c-4b79-84e0-e29435180125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:40.142845 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ea4fa-e94c-4b79-84e0-e29435180125 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:40.143189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ea4fa-e94c-4b79-84e0-e29435180125 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:40.143526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ea4fa-e94c-4b79-84e0-e29435180125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:40.154956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ea4fa-e94c-4b79-84e0-e29435180125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:40.156508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ea4fa-e94c-4b79-84e0-e29435180125 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-202ea4fa-e94c-4b79-84e0-e29435180125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:40.175734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:40.177483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:40.178758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:40.178758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:40.178758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:40.178758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:40.180499 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 304/620] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:40.185208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ea4fa-e94c-4b79-84e0-e29435180125 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:40.222344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:40.233309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573d793-33e5-46b2-b8e7-0109676adfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:40.234129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573d793-33e5-46b2-b8e7-0109676adfbf None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:40.234421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573d793-33e5-46b2-b8e7-0109676adfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:40.234706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573d793-33e5-46b2-b8e7-0109676adfbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:40.261660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573d793-33e5-46b2-b8e7-0109676adfbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:40.263140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573d793-33e5-46b2-b8e7-0109676adfbf None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:40.293845 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ea4fa-e94c-4b79-84e0-e29435180125 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-c573d793-33e5-46b2-b8e7-0109676adfbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:40.297320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:40.298213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:40.299124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:40.299124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:40.299124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:40.299124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:40.309132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 317/621] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:40.316036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573d793-33e5-46b2-b8e7-0109676adfbf None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:40.336640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e5eed-a8f2-4a7d-bad1-8581f7cc83f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:40.336640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e5eed-a8f2-4a7d-bad1-8581f7cc83f6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:40.336640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e5eed-a8f2-4a7d-bad1-8581f7cc83f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:40.336640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e5eed-a8f2-4a7d-bad1-8581f7cc83f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:40.337067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e5eed-a8f2-4a7d-bad1-8581f7cc83f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:40.337067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e5eed-a8f2-4a7d-bad1-8581f7cc83f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:40.337067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e5eed-a8f2-4a7d-bad1-8581f7cc83f6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:40.357149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 305/622] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:40.357149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e5eed-a8f2-4a7d-bad1-8581f7cc83f6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:40.463281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e5eed-a8f2-4a7d-bad1-8581f7cc83f6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:40.464991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:40.465158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:40.500286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a985d2-11f3-4e35-ae2c-76b6e5157aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:40.501402 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a985d2-11f3-4e35-ae2c-76b6e5157aaf None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:40.501849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a985d2-11f3-4e35-ae2c-76b6e5157aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:40.502282 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a985d2-11f3-4e35-ae2c-76b6e5157aaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:40.505257 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573d793-33e5-46b2-b8e7-0109676adfbf None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:40.510553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a985d2-11f3-4e35-ae2c-76b6e5157aaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:40.512265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a985d2-11f3-4e35-ae2c-76b6e5157aaf None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-70a985d2-11f3-4e35-ae2c-76b6e5157aaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:40.527146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:40.528089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:40.529035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:40.529035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:40.529035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:40.529035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:40.529035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:40.529035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:40.529035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:40.529035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:40.531183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 306/623] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:40.537951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58170376-9a4d-4f36-8351-566438166e51 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:40.538422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58170376-9a4d-4f36-8351-566438166e51 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:40.538865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58170376-9a4d-4f36-8351-566438166e51 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:40.540381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 307/624] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:40.541867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58170376-9a4d-4f36-8351-566438166e51 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:40.549942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b847d-b2dc-4aa4-988d-3c745245460b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:40.550698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b847d-b2dc-4aa4-988d-3c745245460b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:40.551059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b847d-b2dc-4aa4-988d-3c745245460b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:40.551501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b847d-b2dc-4aa4-988d-3c745245460b None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:40.552291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b847d-b2dc-4aa4-988d-3c745245460b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:40.552701 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b847d-b2dc-4aa4-988d-3c745245460b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:40.554154 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b847d-b2dc-4aa4-988d-3c745245460b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:40.572712 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 318/625] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:40.574052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ca37-36c3-4b8d-a630-f82abf11f4e2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:40.574344 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ca37-36c3-4b8d-a630-f82abf11f4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:40.574624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ca37-36c3-4b8d-a630-f82abf11f4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:40.598615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2e77ca37-36c3-4b8d-a630-f82abf11f4e2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:40.599909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2e77ca37-36c3-4b8d-a630-f82abf11f4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:40.688637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 319/626] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:40.688637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77ca37-36c3-4b8d-a630-f82abf11f4e2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:40.689838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58170376-9a4d-4f36-8351-566438166e51 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:40.737247 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:40.742594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae215a1-7a13-4cdc-8c6a-38aa02e104bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:40.743547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae215a1-7a13-4cdc-8c6a-38aa02e104bc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:40.744041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae215a1-7a13-4cdc-8c6a-38aa02e104bc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:40.744533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae215a1-7a13-4cdc-8c6a-38aa02e104bc None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:40.745558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae215a1-7a13-4cdc-8c6a-38aa02e104bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:40.746074 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae215a1-7a13-4cdc-8c6a-38aa02e104bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:40.747753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae215a1-7a13-4cdc-8c6a-38aa02e104bc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:40.761216 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 308/627] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:40.762449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae215a1-7a13-4cdc-8c6a-38aa02e104bc None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:40.781993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:40.783774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77ca37-36c3-4b8d-a630-f82abf11f4e2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:40.822377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca0e31-172a-4d66-b85d-57f245e343fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:40.823212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0e31-172a-4d66-b85d-57f245e343fd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:40.823500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0e31-172a-4d66-b85d-57f245e343fd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:40.823785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0e31-172a-4d66-b85d-57f245e343fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:40.831508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca0e31-172a-4d66-b85d-57f245e343fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:40.833874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca0e31-172a-4d66-b85d-57f245e343fd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-68ca0e31-172a-4d66-b85d-57f245e343fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:40.849208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:40.850205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 320/628] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jun 20 06:00:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:40.851613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca0e31-172a-4d66-b85d-57f245e343fd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:40.880306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae215a1-7a13-4cdc-8c6a-38aa02e104bc None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:40.919938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa9e13-ed4f-4ee6-89ab-2be62dfa23ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:40.920879 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa9e13-ed4f-4ee6-89ab-2be62dfa23ea None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:40.921343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa9e13-ed4f-4ee6-89ab-2be62dfa23ea None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:40.921645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa9e13-ed4f-4ee6-89ab-2be62dfa23ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:40.933180 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa9e13-ed4f-4ee6-89ab-2be62dfa23ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-c1fa9e13-ed4f-4ee6-89ab-2be62dfa23ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:40.940955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:40.941892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:40.943393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 309/629] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:40.944119 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa9e13-ed4f-4ee6-89ab-2be62dfa23ea None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:40.968747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca0e31-172a-4d66-b85d-57f245e343fd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:40.984471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:41.005935 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ee7f8-244e-489c-8986-6c97177c3681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:41.006858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee7f8-244e-489c-8986-6c97177c3681 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.007119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee7f8-244e-489c-8986-6c97177c3681 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.007423 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee7f8-244e-489c-8986-6c97177c3681 None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/0aadba0174824781b1866da7ba39956e/roles/acb584c0cfb34695a7cd4ba39aabb279` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.022053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ee7f8-244e-489c-8986-6c97177c3681 None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=0aadba0174824781b1866da7ba39956e, role_id=acb584c0cfb34695a7cd4ba39aabb279)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:41.023511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ee7f8-244e-489c-8986-6c97177c3681 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:41.031311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:41.038049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 321/630] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:00:40 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/0aadba0174824781b1866da7ba39956e/roles/acb584c0cfb34695a7cd4ba39aabb279 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:41.039410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0908-c306-4900-abb7-c71880ba8ca3 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.039711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0908-c306-4900-abb7-c71880ba8ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.039992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0908-c306-4900-abb7-c71880ba8ca3 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.041470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 322/631] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:41.042116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c0908-c306-4900-abb7-c71880ba8ca3 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:41.072413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa9e13-ed4f-4ee6-89ab-2be62dfa23ea None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:41.121457 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045f250-75d4-4db8-87d9-fbd40fcafef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:41.122568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045f250-75d4-4db8-87d9-fbd40fcafef3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.123061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045f250-75d4-4db8-87d9-fbd40fcafef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.123535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045f250-75d4-4db8-87d9-fbd40fcafef3 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.125256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045f250-75d4-4db8-87d9-fbd40fcafef3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:41.126131 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045f250-75d4-4db8-87d9-fbd40fcafef3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:41.128468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045f250-75d4-4db8-87d9-fbd40fcafef3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:41.158354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 310/632] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jun 20 06:00:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:41.158354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db5f8a-8e6d-4ab9-897a-12daf741bae5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.158631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db5f8a-8e6d-4ab9-897a-12daf741bae5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.159564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db5f8a-8e6d-4ab9-897a-12daf741bae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.183788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a5db5f8a-8e6d-4ab9-897a-12daf741bae5 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:41.186081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a5db5f8a-8e6d-4ab9-897a-12daf741bae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:41.189538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c0908-c306-4900-abb7-c71880ba8ca3 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:41.238640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990a400-0178-445b-8161-6c3dc34704e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:41.240219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990a400-0178-445b-8161-6c3dc34704e3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.240506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990a400-0178-445b-8161-6c3dc34704e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.240813 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990a400-0178-445b-8161-6c3dc34704e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.241680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990a400-0178-445b-8161-6c3dc34704e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:41.241990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990a400-0178-445b-8161-6c3dc34704e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:41.243361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990a400-0178-445b-8161-6c3dc34704e3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:41.257043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 323/633] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:41.257964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990a400-0178-445b-8161-6c3dc34704e3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:41.272811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 311/634] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:41.273745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db5f8a-8e6d-4ab9-897a-12daf741bae5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:41.295083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:41.361859 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:41.393434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990a400-0178-445b-8161-6c3dc34704e3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:41.419016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db5f8a-8e6d-4ab9-897a-12daf741bae5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:41.447421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862f7be-c04f-411e-aa13-3500d81cac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:41.448875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f7be-c04f-411e-aa13-3500d81cac22 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.449628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f7be-c04f-411e-aa13-3500d81cac22 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.450081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f7be-c04f-411e-aa13-3500d81cac22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.460115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3711f-6f87-4d4e-858f-52d81ac0ab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:41.460980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3711f-6f87-4d4e-858f-52d81ac0ab4d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.461269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3711f-6f87-4d4e-858f-52d81ac0ab4d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.461544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3711f-6f87-4d4e-858f-52d81ac0ab4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.476645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3711f-6f87-4d4e-858f-52d81ac0ab4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:41.478781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3711f-6f87-4d4e-858f-52d81ac0ab4d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-c5c3711f-6f87-4d4e-858f-52d81ac0ab4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:41.502522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:41.503482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:41.504401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:41.504401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:41.504401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:41.504401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:41.506679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 312/635] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:41.508126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3711f-6f87-4d4e-858f-52d81ac0ab4d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:41.542169 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862f7be-c04f-411e-aa13-3500d81cac22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:41.543620 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862f7be-c04f-411e-aa13-3500d81cac22 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:41.576602 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:41.639043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3711f-6f87-4d4e-858f-52d81ac0ab4d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:41.656065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:41.663964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 324/636] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:41.663964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862f7be-c04f-411e-aa13-3500d81cac22 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:41.682311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e857c89-1769-4f08-beda-b16c0f5b9169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:41.682857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e857c89-1769-4f08-beda-b16c0f5b9169 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.683146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e857c89-1769-4f08-beda-b16c0f5b9169 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.683426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e857c89-1769-4f08-beda-b16c0f5b9169 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.695570 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e857c89-1769-4f08-beda-b16c0f5b9169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-9e857c89-1769-4f08-beda-b16c0f5b9169 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:41.703337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:41.704295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:41.705193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:41.708938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 313/637] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:41.710081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab107e-0cb0-459d-abd6-31f1d21d45ba None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.710372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab107e-0cb0-459d-abd6-31f1d21d45ba None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.710652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab107e-0cb0-459d-abd6-31f1d21d45ba None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.712074 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 314/638] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:41.716568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab107e-0cb0-459d-abd6-31f1d21d45ba None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:41.775318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862f7be-c04f-411e-aa13-3500d81cac22 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:41.806599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:41.816012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd456d0-f947-4bd0-bff7-4be2a04f6c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:41.816716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd456d0-f947-4bd0-bff7-4be2a04f6c6b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.817144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd456d0-f947-4bd0-bff7-4be2a04f6c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.817426 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd456d0-f947-4bd0-bff7-4be2a04f6c6b None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.818274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd456d0-f947-4bd0-bff7-4be2a04f6c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:41.818586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd456d0-f947-4bd0-bff7-4be2a04f6c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:41.820128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd456d0-f947-4bd0-bff7-4be2a04f6c6b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:41.828202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab107e-0cb0-459d-abd6-31f1d21d45ba None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:41.836643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 325/639] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:41.837539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd456d0-f947-4bd0-bff7-4be2a04f6c6b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:41.865562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300a333-29ea-4005-b9ed-ab92614d861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:41.866359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300a333-29ea-4005-b9ed-ab92614d861e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.866647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300a333-29ea-4005-b9ed-ab92614d861e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.866931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300a333-29ea-4005-b9ed-ab92614d861e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.878400 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300a333-29ea-4005-b9ed-ab92614d861e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:41.880141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300a333-29ea-4005-b9ed-ab92614d861e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-7300a333-29ea-4005-b9ed-ab92614d861e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:41.899267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:41.900175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:41.901952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:41.901952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:41.901952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:41.901952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:41.901952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 315/640] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:41.901952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98922-810b-42ac-84ce-3d34577f0736 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.901952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98922-810b-42ac-84ce-3d34577f0736 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.902372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98922-810b-42ac-84ce-3d34577f0736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.919448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e8f98922-810b-42ac-84ce-3d34577f0736 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:41.920652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e8f98922-810b-42ac-84ce-3d34577f0736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:41.945377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:41.948646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd456d0-f947-4bd0-bff7-4be2a04f6c6b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:41.985668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d415a8-819b-417e-82ad-23a5f30b1177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:41.986392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d415a8-819b-417e-82ad-23a5f30b1177 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:41.986680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d415a8-819b-417e-82ad-23a5f30b1177 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:41.987117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d415a8-819b-417e-82ad-23a5f30b1177 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:41.987745 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d415a8-819b-417e-82ad-23a5f30b1177 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:41.988052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d415a8-819b-417e-82ad-23a5f30b1177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:41.990293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d415a8-819b-417e-82ad-23a5f30b1177 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:41.992548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 316/641] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:41.999225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 326/642] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:42.004115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d415a8-819b-417e-82ad-23a5f30b1177 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:42.004574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f98922-810b-42ac-84ce-3d34577f0736 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:42.057006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:42.113615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d415a8-819b-417e-82ad-23a5f30b1177 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:42.121254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f98922-810b-42ac-84ce-3d34577f0736 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:42.150847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ac7e4-5f2e-4726-9d71-7e233d4de288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:42.151513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac7e4-5f2e-4726-9d71-7e233d4de288 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:42.151807 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac7e4-5f2e-4726-9d71-7e233d4de288 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:42.152093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac7e4-5f2e-4726-9d71-7e233d4de288 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:42.152852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ac7e4-5f2e-4726-9d71-7e233d4de288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:42.153166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ac7e4-5f2e-4726-9d71-7e233d4de288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:42.154543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ac7e4-5f2e-4726-9d71-7e233d4de288 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:42.157311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c5fca-920e-41d3-aea5-92e12034369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:42.158106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5fca-920e-41d3-aea5-92e12034369b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:42.158392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5fca-920e-41d3-aea5-92e12034369b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:42.158670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5fca-920e-41d3-aea5-92e12034369b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:42.167168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c5fca-920e-41d3-aea5-92e12034369b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:42.171784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 327/643] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:42.171784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ac7e4-5f2e-4726-9d71-7e233d4de288 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:42.172017 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c5fca-920e-41d3-aea5-92e12034369b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-884c5fca-920e-41d3-aea5-92e12034369b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:42.186551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:42.188851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 317/644] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:42.190692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c5fca-920e-41d3-aea5-92e12034369b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:42.209752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:42.289823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ac7e4-5f2e-4726-9d71-7e233d4de288 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:42.298336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c5fca-920e-41d3-aea5-92e12034369b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:42.299368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:42.329916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74243c-6435-419c-a329-f7da6757a0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:42.330715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74243c-6435-419c-a329-f7da6757a0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:42.330999 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74243c-6435-419c-a329-f7da6757a0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:42.331298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74243c-6435-419c-a329-f7da6757a0b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:42.335632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8d744-f168-4c79-aba3-274128fc31c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:42.336432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d744-f168-4c79-aba3-274128fc31c6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:42.336749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d744-f168-4c79-aba3-274128fc31c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:42.337033 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d744-f168-4c79-aba3-274128fc31c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:42.341783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74243c-6435-419c-a329-f7da6757a0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:42.343245 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74243c-6435-419c-a329-f7da6757a0b9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:42.347873 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8d744-f168-4c79-aba3-274128fc31c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-4dd8d744-f168-4c79-aba3-274128fc31c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:42.356773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:42.357728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:42.358721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 318/645] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:42.359447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8d744-f168-4c79-aba3-274128fc31c6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-5b74243c-6435-419c-a329-f7da6757a0b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:42.367006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:42.367903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:42.368838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:42.368838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:42.368838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:42.368838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:42.372676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 328/646] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:42.373605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74243c-6435-419c-a329-f7da6757a0b9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:42.455248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:42.481965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8d744-f168-4c79-aba3-274128fc31c6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:42.488704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74243c-6435-419c-a329-f7da6757a0b9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:42.518603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65b965-f002-4619-801a-5e1029ad2e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:42.519634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65b965-f002-4619-801a-5e1029ad2e0f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:42.520102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65b965-f002-4619-801a-5e1029ad2e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:42.521525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65b965-f002-4619-801a-5e1029ad2e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:42.525985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3bc41-8814-44d1-ae47-f2c6482f3a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:42.526654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3bc41-8814-44d1-ae47-f2c6482f3a54 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:42.526942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3bc41-8814-44d1-ae47-f2c6482f3a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:42.527221 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3bc41-8814-44d1-ae47-f2c6482f3a54 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:42.528061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3bc41-8814-44d1-ae47-f2c6482f3a54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:42.528373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3bc41-8814-44d1-ae47-f2c6482f3a54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:42.528569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65b965-f002-4619-801a-5e1029ad2e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:42.529837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3bc41-8814-44d1-ae47-f2c6482f3a54 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:42.530368 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65b965-f002-4619-801a-5e1029ad2e0f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1e65b965-f002-4619-801a-5e1029ad2e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:42.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:42.546438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:42.547527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:42.547527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:42.547527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:42.547527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:42.547527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:42.547527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:42.547527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:42.547527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:42.548089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 329/647] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jun 20 06:00:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:42.548886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3bc41-8814-44d1-ae47-f2c6482f3a54 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:42.549630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 319/648] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:42.550594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65b965-f002-4619-801a-5e1029ad2e0f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:42.573424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:42.663456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65b965-f002-4619-801a-5e1029ad2e0f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:42.666306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3bc41-8814-44d1-ae47-f2c6482f3a54 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:42.700505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c79c1-4f99-4627-b2d8-cda0946c2af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:42.701202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c79c1-4f99-4627-b2d8-cda0946c2af7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:42.701481 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c79c1-4f99-4627-b2d8-cda0946c2af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:42.701762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c79c1-4f99-4627-b2d8-cda0946c2af7 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:42.702141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144dc1-1b71-47d0-b1b1-983f7eb8c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:42.702493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c79c1-4f99-4627-b2d8-cda0946c2af7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:42.702807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c79c1-4f99-4627-b2d8-cda0946c2af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:42.703394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144dc1-1b71-47d0-b1b1-983f7eb8c039 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:42.703850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144dc1-1b71-47d0-b1b1-983f7eb8c039 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:42.704199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c79c1-4f99-4627-b2d8-cda0946c2af7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:42.704489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144dc1-1b71-47d0-b1b1-983f7eb8c039 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:42.705460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144dc1-1b71-47d0-b1b1-983f7eb8c039 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:42.705910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144dc1-1b71-47d0-b1b1-983f7eb8c039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:42.707417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144dc1-1b71-47d0-b1b1-983f7eb8c039 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:42.712007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:42.722378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 330/649] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:42.722967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 320/650] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:42.722967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c79c1-4f99-4627-b2d8-cda0946c2af7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:42.723130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144dc1-1b71-47d0-b1b1-983f7eb8c039 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:42.806625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:42.825600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144dc1-1b71-47d0-b1b1-983f7eb8c039 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:42.833736 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c79c1-4f99-4627-b2d8-cda0946c2af7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:42.859948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea9ecc-fcb2-41b8-90a3-b0011a778c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:42.860634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea9ecc-fcb2-41b8-90a3-b0011a778c3a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:42.860924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea9ecc-fcb2-41b8-90a3-b0011a778c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:42.861216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea9ecc-fcb2-41b8-90a3-b0011a778c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:42.869933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100a57f-e1f4-419b-8eae-3841c021c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:42.870810 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a57f-e1f4-419b-8eae-3841c021c203 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:42.871250 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a57f-e1f4-419b-8eae-3841c021c203 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:42.871673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a57f-e1f4-419b-8eae-3841c021c203 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:42.872638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100a57f-e1f4-419b-8eae-3841c021c203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:42.873145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100a57f-e1f4-419b-8eae-3841c021c203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:42.874717 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100a57f-e1f4-419b-8eae-3841c021c203 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:42.892310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 321/651] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:42.893197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100a57f-e1f4-419b-8eae-3841c021c203 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:42.935882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea9ecc-fcb2-41b8-90a3-b0011a778c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:42.937782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea9ecc-fcb2-41b8-90a3-b0011a778c3a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:42.955887 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:43.003054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100a57f-e1f4-419b-8eae-3841c021c203 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:43.022111 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:43.043473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73593d-4d72-473a-a066-503f85ab5bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:43.044270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73593d-4d72-473a-a066-503f85ab5bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.044554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73593d-4d72-473a-a066-503f85ab5bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.044926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73593d-4d72-473a-a066-503f85ab5bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:43.048256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 331/652] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:43.049161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea9ecc-fcb2-41b8-90a3-b0011a778c3a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:43.057511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73593d-4d72-473a-a066-503f85ab5bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:43.058997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73593d-4d72-473a-a066-503f85ab5bf4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-0d73593d-4d72-473a-a066-503f85ab5bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:43.078515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:43.079478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:43.080425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:43.080425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:43.080425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:43.080425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:43.080425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 322/653] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:43.080737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73593d-4d72-473a-a066-503f85ab5bf4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:43.165558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea9ecc-fcb2-41b8-90a3-b0011a778c3a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:43.189411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73593d-4d72-473a-a066-503f85ab5bf4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:43.200542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:43.202028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fe20-a19b-46fd-ade5-adfc7afe4862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:43.203112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fe20-a19b-46fd-ade5-adfc7afe4862 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.203399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fe20-a19b-46fd-ade5-adfc7afe4862 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.203676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fe20-a19b-46fd-ade5-adfc7afe4862 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:43.211350 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853fe20-a19b-46fd-ade5-adfc7afe4862 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:43.212842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853fe20-a19b-46fd-ade5-adfc7afe4862 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:43.225675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806fc10-fe9f-4137-8a83-46f5fb00edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:43.226326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806fc10-fe9f-4137-8a83-46f5fb00edf4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.226612 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806fc10-fe9f-4137-8a83-46f5fb00edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.226889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806fc10-fe9f-4137-8a83-46f5fb00edf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6853fe20-a19b-46fd-ade5-adfc7afe4862 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:43.227184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:43.228303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:43.229501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:43.229501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:43.229501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:43.229501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:43.229501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:43.229501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:43.229501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:43.229501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:43.229501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 06:00:43.229501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:43.230158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806fc10-fe9f-4137-8a83-46f5fb00edf4 None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=3748d8369d20429eb2376ce02d42eee0) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:43.230158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806fc10-fe9f-4137-8a83-46f5fb00edf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:43.230158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806fc10-fe9f-4137-8a83-46f5fb00edf4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:43.232883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 332/654] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:43.233705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fe20-a19b-46fd-ade5-adfc7afe4862 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:43.235797 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 323/655] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:43 2022] GET /identity/v3/role_assignments?user.id=3748d8369d20429eb2376ce02d42eee0&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:43.236639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806fc10-fe9f-4137-8a83-46f5fb00edf4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:43.282903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:43.350763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fe20-a19b-46fd-ade5-adfc7afe4862 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:43.370653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806fc10-fe9f-4137-8a83-46f5fb00edf4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:43.390226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005697e-b15e-4eef-be72-0c91d0dfc81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:43.391040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005697e-b15e-4eef-be72-0c91d0dfc81b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.391345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005697e-b15e-4eef-be72-0c91d0dfc81b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.391608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005697e-b15e-4eef-be72-0c91d0dfc81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:43.404037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005697e-b15e-4eef-be72-0c91d0dfc81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:43.405756 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005697e-b15e-4eef-be72-0c91d0dfc81b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:43.415370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5197bb3-f03c-4a7b-88d7-eac0116fa897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:43.416506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5197bb3-f03c-4a7b-88d7-eac0116fa897 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.416506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5197bb3-f03c-4a7b-88d7-eac0116fa897 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.416744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5197bb3-f03c-4a7b-88d7-eac0116fa897 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:43.417377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5197bb3-f03c-4a7b-88d7-eac0116fa897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:43.417692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5197bb3-f03c-4a7b-88d7-eac0116fa897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:43.419213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5197bb3-f03c-4a7b-88d7-eac0116fa897 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-7005697e-b15e-4eef-be72-0c91d0dfc81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:43.425141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:43.426063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:43.427014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:43.427014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:43.427014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:43.427014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:43.427014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 333/656] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:43.427856 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945367a5-74d3-4231-90ef-84bfa7394ad5 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.428139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945367a5-74d3-4231-90ef-84bfa7394ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.428420 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945367a5-74d3-4231-90ef-84bfa7394ad5 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:43.430001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 334/657] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:43.430409 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945367a5-74d3-4231-90ef-84bfa7394ad5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:43.435655 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 324/658] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:43.436890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5197bb3-f03c-4a7b-88d7-eac0116fa897 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:43.482935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:43.545108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:43.556554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945367a5-74d3-4231-90ef-84bfa7394ad5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:43.557591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5197bb3-f03c-4a7b-88d7-eac0116fa897 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:43.593257 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80cae8-a9a8-4356-a8c6-e101c104e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:43.593927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80cae8-a9a8-4356-a8c6-e101c104e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.594219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80cae8-a9a8-4356-a8c6-e101c104e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.594500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80cae8-a9a8-4356-a8c6-e101c104e5b0 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:43.595336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80cae8-a9a8-4356-a8c6-e101c104e5b0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:43.595652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80cae8-a9a8-4356-a8c6-e101c104e5b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:43.597109 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80cae8-a9a8-4356-a8c6-e101c104e5b0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:43.597709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3992aa-3305-41cf-9581-d0cd0d802fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:43.599131 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3992aa-3305-41cf-9581-d0cd0d802fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.599423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3992aa-3305-41cf-9581-d0cd0d802fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.599701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3992aa-3305-41cf-9581-d0cd0d802fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:43.600644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3992aa-3305-41cf-9581-d0cd0d802fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:43.600754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3992aa-3305-41cf-9581-d0cd0d802fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:43.602149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3992aa-3305-41cf-9581-d0cd0d802fc0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:43.618484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 325/659] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:43.618484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608f7e9-c195-47fb-9fe8-2b0c1b648d54 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.618484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608f7e9-c195-47fb-9fe8-2b0c1b648d54 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.618484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608f7e9-c195-47fb-9fe8-2b0c1b648d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:43.620575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 335/660] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jun 20 06:00:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:43.621442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80cae8-a9a8-4356-a8c6-e101c104e5b0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:43.640211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a608f7e9-c195-47fb-9fe8-2b0c1b648d54 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:43.641449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a608f7e9-c195-47fb-9fe8-2b0c1b648d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:43.714915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 326/661] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:43.715937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608f7e9-c195-47fb-9fe8-2b0c1b648d54 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:43.734517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80cae8-a9a8-4356-a8c6-e101c104e5b0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:43.753010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:43.774015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ce682-bbb1-4086-8a26-e4f30d7e3dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:43.774831 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ce682-bbb1-4086-8a26-e4f30d7e3dcd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.775106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ce682-bbb1-4086-8a26-e4f30d7e3dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.775385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ce682-bbb1-4086-8a26-e4f30d7e3dcd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:43.783130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ce682-bbb1-4086-8a26-e4f30d7e3dcd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:43.784868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ce682-bbb1-4086-8a26-e4f30d7e3dcd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b98ce682-bbb1-4086-8a26-e4f30d7e3dcd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:43.801018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:43.802235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 336/662] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:43.807866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ce682-bbb1-4086-8a26-e4f30d7e3dcd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:43.821851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:43.844897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608f7e9-c195-47fb-9fe8-2b0c1b648d54 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:43.880942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbcbcb-350c-4691-9fa3-452da9ce2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:43.881664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbcbcb-350c-4691-9fa3-452da9ce2da6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.881950 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbcbcb-350c-4691-9fa3-452da9ce2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.882226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbcbcb-350c-4691-9fa3-452da9ce2da6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:43.889264 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbcbcb-350c-4691-9fa3-452da9ce2da6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:43.890720 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbcbcb-350c-4691-9fa3-452da9ce2da6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-aedbcbcb-350c-4691-9fa3-452da9ce2da6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:43.905842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:43.906789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:43.907840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:43.907840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:43.907840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:43.907840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:43.907840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:43.907840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:43.907840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:43.907840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:43.907840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 327/663] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:43.907840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbcbcb-350c-4691-9fa3-452da9ce2da6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:43.925863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ce682-bbb1-4086-8a26-e4f30d7e3dcd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:43.963918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccb43e-2f92-424e-aab4-81d716351289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:43.964920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccb43e-2f92-424e-aab4-81d716351289 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:43.965446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccb43e-2f92-424e-aab4-81d716351289 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:43.965936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccb43e-2f92-424e-aab4-81d716351289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:44.001133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:44.022105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbcbcb-350c-4691-9fa3-452da9ce2da6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:44.040561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccb43e-2f92-424e-aab4-81d716351289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:44.042081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccb43e-2f92-424e-aab4-81d716351289 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:44.055025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:44.060279 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dbc34-c8fb-4e3c-969a-1c17a0fa091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:44.061125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbc34-c8fb-4e3c-969a-1c17a0fa091c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:44.061421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbc34-c8fb-4e3c-969a-1c17a0fa091c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:44.061690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbc34-c8fb-4e3c-969a-1c17a0fa091c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:44.072491 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dbc34-c8fb-4e3c-969a-1c17a0fa091c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-223dbc34-c8fb-4e3c-969a-1c17a0fa091c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:44.080566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:44.081615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:44.082489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 328/664] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:44.083547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dbc34-c8fb-4e3c-969a-1c17a0fa091c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:44.155634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 337/665] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:44.156425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccb43e-2f92-424e-aab4-81d716351289 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:44.196627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dbc34-c8fb-4e3c-969a-1c17a0fa091c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:44.231445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482b8e7-7fb9-4641-8e57-778a77979cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:44.232456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482b8e7-7fb9-4641-8e57-778a77979cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:44.232456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482b8e7-7fb9-4641-8e57-778a77979cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:44.232689 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482b8e7-7fb9-4641-8e57-778a77979cb7 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:44.233710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482b8e7-7fb9-4641-8e57-778a77979cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:44.234031 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482b8e7-7fb9-4641-8e57-778a77979cb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:44.235459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482b8e7-7fb9-4641-8e57-778a77979cb7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:44.254189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 329/666] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Jun 20 06:00:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:44.255715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482b8e7-7fb9-4641-8e57-778a77979cb7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:44.258636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:44.268590 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccb43e-2f92-424e-aab4-81d716351289 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:44.280496 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:44.306824 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105bb73-6785-4f0c-8dfd-b545e3cf2d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:44.307488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105bb73-6785-4f0c-8dfd-b545e3cf2d59 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:44.307782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105bb73-6785-4f0c-8dfd-b545e3cf2d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:44.308049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105bb73-6785-4f0c-8dfd-b545e3cf2d59 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:44.308864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105bb73-6785-4f0c-8dfd-b545e3cf2d59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:44.309184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105bb73-6785-4f0c-8dfd-b545e3cf2d59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:44.310616 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105bb73-6785-4f0c-8dfd-b545e3cf2d59 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:44.322866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 338/667] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:44.328153 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105bb73-6785-4f0c-8dfd-b545e3cf2d59 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:44.367850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482b8e7-7fb9-4641-8e57-778a77979cb7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:44.404340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd139db2-7456-4e0f-b8c7-fa8db20a04f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:44.405230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139db2-7456-4e0f-b8c7-fa8db20a04f3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:44.405700 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139db2-7456-4e0f-b8c7-fa8db20a04f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:44.406067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139db2-7456-4e0f-b8c7-fa8db20a04f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:44.406951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd139db2-7456-4e0f-b8c7-fa8db20a04f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:44.407380 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd139db2-7456-4e0f-b8c7-fa8db20a04f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:44.408891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd139db2-7456-4e0f-b8c7-fa8db20a04f3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:44.423485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 330/668] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:44.423485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd139db2-7456-4e0f-b8c7-fa8db20a04f3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:44.443327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105bb73-6785-4f0c-8dfd-b545e3cf2d59 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:44.482703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31e121-ad06-4605-a91c-61f8a8566b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:44.483509 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e121-ad06-4605-a91c-61f8a8566b5f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:44.483799 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e121-ad06-4605-a91c-61f8a8566b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:44.484080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e121-ad06-4605-a91c-61f8a8566b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:44.494955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:44.495315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31e121-ad06-4605-a91c-61f8a8566b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:44.496862 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31e121-ad06-4605-a91c-61f8a8566b5f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6f31e121-ad06-4605-a91c-61f8a8566b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:44.514604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:44.515532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:44.516446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:44.516446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:44.516446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:44.516446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:44.516446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 339/669] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:44.516761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31e121-ad06-4605-a91c-61f8a8566b5f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:44.540534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd139db2-7456-4e0f-b8c7-fa8db20a04f3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:44.545219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:44.576031 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609dccf-2fd5-43c1-aea6-b175c3063147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:44.577146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609dccf-2fd5-43c1-aea6-b175c3063147 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:44.577639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609dccf-2fd5-43c1-aea6-b175c3063147 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:44.577971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609dccf-2fd5-43c1-aea6-b175c3063147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:44.632398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31e121-ad06-4605-a91c-61f8a8566b5f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:44.652344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609dccf-2fd5-43c1-aea6-b175c3063147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:44.654641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609dccf-2fd5-43c1-aea6-b175c3063147 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:44.668157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc4d12-ffc2-4632-8c38-d1e914a2a62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:44.668783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4d12-ffc2-4632-8c38-d1e914a2a62d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:44.669076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4d12-ffc2-4632-8c38-d1e914a2a62d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:44.669359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4d12-ffc2-4632-8c38-d1e914a2a62d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:44.670191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc4d12-ffc2-4632-8c38-d1e914a2a62d None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=3780488ee9404b3b8eda52acf8dceca3) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:44.670511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc4d12-ffc2-4632-8c38-d1e914a2a62d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:44.671947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc4d12-ffc2-4632-8c38-d1e914a2a62d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:44.678026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 340/670] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:44 2022] GET /identity/v3/role_assignments?user.id=3780488ee9404b3b8eda52acf8dceca3&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:44.689003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc4d12-ffc2-4632-8c38-d1e914a2a62d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:44.738657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:44.793913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 331/671] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:44.794873 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609dccf-2fd5-43c1-aea6-b175c3063147 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:44.804708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:44.829357 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc4d12-ffc2-4632-8c38-d1e914a2a62d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:44.876124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23225a63-d448-4ce2-acfc-47f024412faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:44.877000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23225a63-d448-4ce2-acfc-47f024412faa None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:44.877288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23225a63-d448-4ce2-acfc-47f024412faa None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:44.877571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23225a63-d448-4ce2-acfc-47f024412faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:44.893934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23225a63-d448-4ce2-acfc-47f024412faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:44.895491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23225a63-d448-4ce2-acfc-47f024412faa None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-23225a63-d448-4ce2-acfc-47f024412faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:44.915839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:44.916853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:44.917772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:44.917772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:44.917772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:44.917772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:44.917772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 341/672] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:44.918515 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23225a63-d448-4ce2-acfc-47f024412faa None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:44.922257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609dccf-2fd5-43c1-aea6-b175c3063147 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:44.963563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceaa30-f143-46c8-ac37-10e07c118d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:44.964253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceaa30-f143-46c8-ac37-10e07c118d5f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:44.964587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceaa30-f143-46c8-ac37-10e07c118d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:44.964931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceaa30-f143-46c8-ac37-10e07c118d5f None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:44.965710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faceaa30-f143-46c8-ac37-10e07c118d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:44.966048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faceaa30-f143-46c8-ac37-10e07c118d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:44.967534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faceaa30-f143-46c8-ac37-10e07c118d5f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:44.988847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 332/673] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:44.988847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceaa30-f143-46c8-ac37-10e07c118d5f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:45.021619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:45.048882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23225a63-d448-4ce2-acfc-47f024412faa None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:45.098011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaff9ab-966f-4a23-a4bf-6d92abb14cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:45.100046 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaff9ab-966f-4a23-a4bf-6d92abb14cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:45.100912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaff9ab-966f-4a23-a4bf-6d92abb14cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:45.101400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaff9ab-966f-4a23-a4bf-6d92abb14cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:45.110528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:45.122454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceaa30-f143-46c8-ac37-10e07c118d5f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:45.131051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaff9ab-966f-4a23-a4bf-6d92abb14cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:45.132850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaff9ab-966f-4a23-a4bf-6d92abb14cf9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-faaff9ab-966f-4a23-a4bf-6d92abb14cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:45.152131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:45.153348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:45.154288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:45.154288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:45.154288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:45.154288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:45.156424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 342/674] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:45.157480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaff9ab-966f-4a23-a4bf-6d92abb14cf9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:45.165332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fd294-65a2-4242-bf20-b1b7d32288da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:45.166091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd294-65a2-4242-bf20-b1b7d32288da None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:45.166459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd294-65a2-4242-bf20-b1b7d32288da None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:45.166812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd294-65a2-4242-bf20-b1b7d32288da None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:45.167622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fd294-65a2-4242-bf20-b1b7d32288da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:45.168045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fd294-65a2-4242-bf20-b1b7d32288da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:45.170283 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fd294-65a2-4242-bf20-b1b7d32288da None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:45.188748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 333/675] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:45.189875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fd294-65a2-4242-bf20-b1b7d32288da None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:45.271310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaff9ab-966f-4a23-a4bf-6d92abb14cf9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:45.301352 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:45.308018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80842481-2d89-4e47-8445-423b6d8b15dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:45.309118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80842481-2d89-4e47-8445-423b6d8b15dc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:45.309588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80842481-2d89-4e47-8445-423b6d8b15dc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:45.310046 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80842481-2d89-4e47-8445-423b6d8b15dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:45.314022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fd294-65a2-4242-bf20-b1b7d32288da None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:45.318177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80842481-2d89-4e47-8445-423b6d8b15dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:45.319922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80842481-2d89-4e47-8445-423b6d8b15dc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-80842481-2d89-4e47-8445-423b6d8b15dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:45.336928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:45.337868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:45.338775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:45.338775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:45.338775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:45.338775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:45.338775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:45.338775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:45.338775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:45.338775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:45.346044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 343/676] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:45.347249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80842481-2d89-4e47-8445-423b6d8b15dc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:45.350499 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774db1-9421-4624-bd23-2041a382328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:45.351167 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774db1-9421-4624-bd23-2041a382328c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:45.351447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774db1-9421-4624-bd23-2041a382328c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:45.351738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774db1-9421-4624-bd23-2041a382328c None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:45.352452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3774db1-9421-4624-bd23-2041a382328c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:45.352803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3774db1-9421-4624-bd23-2041a382328c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:45.354188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3774db1-9421-4624-bd23-2041a382328c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:45.370394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 334/677] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:45.371289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774db1-9421-4624-bd23-2041a382328c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:45.406095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:45.460821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80842481-2d89-4e47-8445-423b6d8b15dc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:45.477972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774db1-9421-4624-bd23-2041a382328c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:45.495774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf720b3-99c1-45f5-8a42-e10eb571bcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:45.496579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf720b3-99c1-45f5-8a42-e10eb571bcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:45.497057 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf720b3-99c1-45f5-8a42-e10eb571bcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:45.497342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf720b3-99c1-45f5-8a42-e10eb571bcf8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:45.505622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf720b3-99c1-45f5-8a42-e10eb571bcf8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:45.507082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf720b3-99c1-45f5-8a42-e10eb571bcf8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:45.515592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752f52-f0a1-49cb-b4ff-82934bb18e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:45.516252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752f52-f0a1-49cb-b4ff-82934bb18e4a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:45.516536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752f52-f0a1-49cb-b4ff-82934bb18e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:45.516863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752f52-f0a1-49cb-b4ff-82934bb18e4a None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:45.517625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752f52-f0a1-49cb-b4ff-82934bb18e4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:45.517935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752f52-f0a1-49cb-b4ff-82934bb18e4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:45.519347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752f52-f0a1-49cb-b4ff-82934bb18e4a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-8cf720b3-99c1-45f5-8a42-e10eb571bcf8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:45.522748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:45.523869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:45.524986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:45.524986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:45.524986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:45.524986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:45.524986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:45.524986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:45.524986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:45.524986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:45.524986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:00:45.524986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:45.524986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 344/678] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:45.525628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf720b3-99c1-45f5-8a42-e10eb571bcf8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:45.543427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 335/679] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:45.543427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50385f-3852-4154-9d10-5c35a75e18cc None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:45.543427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50385f-3852-4154-9d10-5c35a75e18cc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:45.543427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50385f-3852-4154-9d10-5c35a75e18cc None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:45.543427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 336/680] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:45.543427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50385f-3852-4154-9d10-5c35a75e18cc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:45.548678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:45.640522 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf720b3-99c1-45f5-8a42-e10eb571bcf8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:45.653540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:45.656879 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50385f-3852-4154-9d10-5c35a75e18cc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:45.680580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fdd1d-a88e-4e09-933a-9a0a5a64ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:45.681515 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fdd1d-a88e-4e09-933a-9a0a5a64ad14 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:45.681795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fdd1d-a88e-4e09-933a-9a0a5a64ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:45.682086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fdd1d-a88e-4e09-933a-9a0a5a64ad14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:45.688976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fdd1d-a88e-4e09-933a-9a0a5a64ad14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:45.690659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fdd1d-a88e-4e09-933a-9a0a5a64ad14 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:45.695626 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b55e3-35ae-4224-8e50-15176a502a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:45.696297 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b55e3-35ae-4224-8e50-15176a502a0d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:45.696758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b55e3-35ae-4224-8e50-15176a502a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:45.697174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b55e3-35ae-4224-8e50-15176a502a0d None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:45.698018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b55e3-35ae-4224-8e50-15176a502a0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:45.698334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b55e3-35ae-4224-8e50-15176a502a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:45.699758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b55e3-35ae-4224-8e50-15176a502a0d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-df7fdd1d-a88e-4e09-933a-9a0a5a64ad14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:45.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:45.706031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:45.707043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:45.707043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:45.707043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:45.707043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:45.707043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:45.707043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:45.707043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:45.707043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:45.707043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 345/681] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:45.707043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fdd1d-a88e-4e09-933a-9a0a5a64ad14 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:45.725331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 337/682] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jun 20 06:00:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:45.726553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868306-b65a-456d-8f31-156a0f734502 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:45.726846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868306-b65a-456d-8f31-156a0f734502 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:45.727127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868306-b65a-456d-8f31-156a0f734502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:45.743632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-56868306-b65a-456d-8f31-156a0f734502 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:45.744856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-56868306-b65a-456d-8f31-156a0f734502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:45.806006 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:45.817824 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fdd1d-a88e-4e09-933a-9a0a5a64ad14 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:45.820664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 338/683] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:45.820664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56868306-b65a-456d-8f31-156a0f734502 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:45.859397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c1c49-3986-465c-bdaf-0bfc03b279ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:45.860148 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1c49-3986-465c-bdaf-0bfc03b279ae None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:45.860431 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1c49-3986-465c-bdaf-0bfc03b279ae None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:45.860743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1c49-3986-465c-bdaf-0bfc03b279ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:45.861566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c1c49-3986-465c-bdaf-0bfc03b279ae None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=7071b87350864e478e848e7d3d66e33e) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:45.861879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c1c49-3986-465c-bdaf-0bfc03b279ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:45.863295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c1c49-3986-465c-bdaf-0bfc03b279ae None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:45.876658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 346/684] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:45 2022] GET /identity/v3/role_assignments?user.id=7071b87350864e478e848e7d3d66e33e&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:45.876658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c1c49-3986-465c-bdaf-0bfc03b279ae None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:45.926773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:45.967092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56868306-b65a-456d-8f31-156a0f734502 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:46.013256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c1c49-3986-465c-bdaf-0bfc03b279ae None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:46.017280 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0007-e8d1-4fa9-b78f-9d5fe8065047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:46.017968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0007-e8d1-4fa9-b78f-9d5fe8065047 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:46.018260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0007-e8d1-4fa9-b78f-9d5fe8065047 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:46.018545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0007-e8d1-4fa9-b78f-9d5fe8065047 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:46.019360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0007-e8d1-4fa9-b78f-9d5fe8065047 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:46.019679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0007-e8d1-4fa9-b78f-9d5fe8065047 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:46.022569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0007-e8d1-4fa9-b78f-9d5fe8065047 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:46.040765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 339/685] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:46.041551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0007-e8d1-4fa9-b78f-9d5fe8065047 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:46.055215 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f150cd-4ed1-4cce-86ba-dad534c1aeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:46.055969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f150cd-4ed1-4cce-86ba-dad534c1aeba None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:46.056265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f150cd-4ed1-4cce-86ba-dad534c1aeba None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:46.056545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f150cd-4ed1-4cce-86ba-dad534c1aeba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:46.109019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:46.145962 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f150cd-4ed1-4cce-86ba-dad534c1aeba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:46.148122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f150cd-4ed1-4cce-86ba-dad534c1aeba None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:46.182848 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0007-e8d1-4fa9-b78f-9d5fe8065047 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:46.185803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:46.229858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1345fc2-b49a-4296-a7ca-962f44c63078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:46.230910 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1345fc2-b49a-4296-a7ca-962f44c63078 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:46.231371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1345fc2-b49a-4296-a7ca-962f44c63078 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:46.231794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1345fc2-b49a-4296-a7ca-962f44c63078 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:46.246592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1345fc2-b49a-4296-a7ca-962f44c63078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-a1345fc2-b49a-4296-a7ca-962f44c63078 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:46.254857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:46.255946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:46.256832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:46.261271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 340/686] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:46.262211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1345fc2-b49a-4296-a7ca-962f44c63078 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:46.268381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 347/687] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:46.269482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f150cd-4ed1-4cce-86ba-dad534c1aeba None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:46.372525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1345fc2-b49a-4296-a7ca-962f44c63078 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:46.387106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:46.403394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f150cd-4ed1-4cce-86ba-dad534c1aeba None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:46.412473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af72f-e1cf-4fff-b4fc-2126144fd331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:46.413302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af72f-e1cf-4fff-b4fc-2126144fd331 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:46.413690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af72f-e1cf-4fff-b4fc-2126144fd331 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:46.414072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af72f-e1cf-4fff-b4fc-2126144fd331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:46.415317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5af72f-e1cf-4fff-b4fc-2126144fd331 None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=9d21089ce5b140ab9549816b8cb38316) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:46.415317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5af72f-e1cf-4fff-b4fc-2126144fd331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:46.416990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5af72f-e1cf-4fff-b4fc-2126144fd331 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:46.424358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 341/688] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:46 2022] GET /identity/v3/role_assignments?user.id=9d21089ce5b140ab9549816b8cb38316&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:46.425338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af72f-e1cf-4fff-b4fc-2126144fd331 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:46.475321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c31236-a036-4555-9f0c-7ecbb4b893a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:46.476254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c31236-a036-4555-9f0c-7ecbb4b893a0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:46.481303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c31236-a036-4555-9f0c-7ecbb4b893a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:46.481909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c31236-a036-4555-9f0c-7ecbb4b893a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:46.482907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c31236-a036-4555-9f0c-7ecbb4b893a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:46.483228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c31236-a036-4555-9f0c-7ecbb4b893a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:46.484675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c31236-a036-4555-9f0c-7ecbb4b893a0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:46.486458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:46.508640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 348/689] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:46.511723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c31236-a036-4555-9f0c-7ecbb4b893a0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:46.558831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af72f-e1cf-4fff-b4fc-2126144fd331 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:46.625336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f93b97-0530-474c-82e5-57a1b3890d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:46.626538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f93b97-0530-474c-82e5-57a1b3890d1a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:46.627032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f93b97-0530-474c-82e5-57a1b3890d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:46.628671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f93b97-0530-474c-82e5-57a1b3890d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:46.654594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f93b97-0530-474c-82e5-57a1b3890d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:46.657231 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f93b97-0530-474c-82e5-57a1b3890d1a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-86f93b97-0530-474c-82e5-57a1b3890d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:46.680870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:46.681851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:46.682776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:46.682776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:46.682776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:46.682776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:46.685648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 342/690] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:46.691339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f93b97-0530-474c-82e5-57a1b3890d1a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:46.729979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c31236-a036-4555-9f0c-7ecbb4b893a0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:46.732422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:46.771347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d52ab-92c7-47b4-84d6-f11ed29c82fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:46.772464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d52ab-92c7-47b4-84d6-f11ed29c82fc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:46.772936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d52ab-92c7-47b4-84d6-f11ed29c82fc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:46.773363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d52ab-92c7-47b4-84d6-f11ed29c82fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:46.786584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d52ab-92c7-47b4-84d6-f11ed29c82fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:46.788310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d52ab-92c7-47b4-84d6-f11ed29c82fc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-663d52ab-92c7-47b4-84d6-f11ed29c82fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:46.807682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:46.808716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:46.809709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:46.809709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:46.809709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:46.809709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:46.816059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 349/691] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:46.818089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d52ab-92c7-47b4-84d6-f11ed29c82fc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:46.823563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f93b97-0530-474c-82e5-57a1b3890d1a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:46.861135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144e4e-fc63-4c1b-9934-a3ae3670624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:46.861899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144e4e-fc63-4c1b-9934-a3ae3670624b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:46.862293 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144e4e-fc63-4c1b-9934-a3ae3670624b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:46.862640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144e4e-fc63-4c1b-9934-a3ae3670624b None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:46.863435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144e4e-fc63-4c1b-9934-a3ae3670624b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:46.864336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144e4e-fc63-4c1b-9934-a3ae3670624b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:46.866557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144e4e-fc63-4c1b-9934-a3ae3670624b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:46.875281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:46.883028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 343/692] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:46.888356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144e4e-fc63-4c1b-9934-a3ae3670624b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:46.940213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d52ab-92c7-47b4-84d6-f11ed29c82fc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:46.999473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:47.019697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8824c-6be6-48bd-894f-b5bd1ba79ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:47.020967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8824c-6be6-48bd-894f-b5bd1ba79ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:47.021236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8824c-6be6-48bd-894f-b5bd1ba79ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:47.021515 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8824c-6be6-48bd-894f-b5bd1ba79ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:47.022256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8824c-6be6-48bd-894f-b5bd1ba79ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:47.022568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8824c-6be6-48bd-894f-b5bd1ba79ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:47.022932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144e4e-fc63-4c1b-9934-a3ae3670624b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:47.023943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8824c-6be6-48bd-894f-b5bd1ba79ca7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:47.043775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 350/693] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:47.043775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd43ec-f794-4035-ab60-7d7e4840c6c4 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:47.043775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd43ec-f794-4035-ab60-7d7e4840c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:47.043775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd43ec-f794-4035-ab60-7d7e4840c6c4 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:47.043775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 351/694] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:47.048684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd43ec-f794-4035-ab60-7d7e4840c6c4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:47.069747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6d323-2de6-48ad-b3bf-b3bce237efc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:47.070858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d323-2de6-48ad-b3bf-b3bce237efc3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:47.071359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d323-2de6-48ad-b3bf-b3bce237efc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:47.071808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d323-2de6-48ad-b3bf-b3bce237efc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:47.079298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6d323-2de6-48ad-b3bf-b3bce237efc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:47.081030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6d323-2de6-48ad-b3bf-b3bce237efc3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-94a6d323-2de6-48ad-b3bf-b3bce237efc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:47.096975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:47.097909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:47.099574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:47.099574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:47.099574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:47.099574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:47.099574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:47.099574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:47.099574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:47.099574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:47.099574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 344/695] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:47.100353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ad7f9-ab83-47e2-9282-398bd75cb463 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:47.100353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ad7f9-ab83-47e2-9282-398bd75cb463 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:47.100488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ad7f9-ab83-47e2-9282-398bd75cb463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:47.119511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6f8ad7f9-ab83-47e2-9282-398bd75cb463 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:47.120938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6f8ad7f9-ab83-47e2-9282-398bd75cb463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:47.183417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd43ec-f794-4035-ab60-7d7e4840c6c4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:47.197120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:47.201142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 345/696] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:47.202409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ad7f9-ab83-47e2-9282-398bd75cb463 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:47.245460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f4977-b61f-4b08-8faf-f53b299c07b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:47.246655 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f4977-b61f-4b08-8faf-f53b299c07b2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:47.246970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f4977-b61f-4b08-8faf-f53b299c07b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:47.247489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f4977-b61f-4b08-8faf-f53b299c07b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:47.257032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f4977-b61f-4b08-8faf-f53b299c07b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:47.258487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f4977-b61f-4b08-8faf-f53b299c07b2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-d64f4977-b61f-4b08-8faf-f53b299c07b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:47.278097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:47.279318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:47.280339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:47.280339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:47.280339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:47.280339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:47.280339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:47.280339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:47.280339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:47.280339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:47.280339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:47.280339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:47.280339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 352/697] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jun 20 06:00:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:47.280976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f4977-b61f-4b08-8faf-f53b299c07b2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:47.309481 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:47.334727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ad7f9-ab83-47e2-9282-398bd75cb463 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:47.373497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568e40e-60c9-4b4e-be9b-07b176ddb9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:47.374597 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568e40e-60c9-4b4e-be9b-07b176ddb9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:47.375097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568e40e-60c9-4b4e-be9b-07b176ddb9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:47.375608 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568e40e-60c9-4b4e-be9b-07b176ddb9e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:47.376583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568e40e-60c9-4b4e-be9b-07b176ddb9e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:47.377126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568e40e-60c9-4b4e-be9b-07b176ddb9e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:47.378744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568e40e-60c9-4b4e-be9b-07b176ddb9e9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:47.392189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 346/698] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:47.393371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568e40e-60c9-4b4e-be9b-07b176ddb9e9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:47.415700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f4977-b61f-4b08-8faf-f53b299c07b2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:47.454487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97037df-4c3e-4da5-9c8e-0741e4ea2b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:47.455420 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97037df-4c3e-4da5-9c8e-0741e4ea2b49 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:47.455707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97037df-4c3e-4da5-9c8e-0741e4ea2b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:47.455987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97037df-4c3e-4da5-9c8e-0741e4ea2b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:47.468034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97037df-4c3e-4da5-9c8e-0741e4ea2b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:47.469561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97037df-4c3e-4da5-9c8e-0741e4ea2b49 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e97037df-4c3e-4da5-9c8e-0741e4ea2b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:47.491828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:47.492829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:47.493758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:47.493758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:47.493758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:47.493758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:47.493758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 353/699] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:47.494316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97037df-4c3e-4da5-9c8e-0741e4ea2b49 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:47.506027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568e40e-60c9-4b4e-be9b-07b176ddb9e9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:47.518716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:47.553126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe491f-6505-4f58-992a-77dc629ac1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:47.554165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe491f-6505-4f58-992a-77dc629ac1de None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:47.554602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe491f-6505-4f58-992a-77dc629ac1de None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:47.555127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe491f-6505-4f58-992a-77dc629ac1de None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:47.556147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe491f-6505-4f58-992a-77dc629ac1de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:47.556639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe491f-6505-4f58-992a-77dc629ac1de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:47.558342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe491f-6505-4f58-992a-77dc629ac1de None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:47.568215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:47.578872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 347/700] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jun 20 06:00:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:47.579996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe491f-6505-4f58-992a-77dc629ac1de None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:47.611671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97037df-4c3e-4da5-9c8e-0741e4ea2b49 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:47.650279 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed78b3c-2e99-4a22-9c1b-172ccb1e7cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:47.651053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed78b3c-2e99-4a22-9c1b-172ccb1e7cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:47.651337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed78b3c-2e99-4a22-9c1b-172ccb1e7cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:47.651616 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed78b3c-2e99-4a22-9c1b-172ccb1e7cf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:47.652447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed78b3c-2e99-4a22-9c1b-172ccb1e7cf0 None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=0aadba0174824781b1866da7ba39956e) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:47.652793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed78b3c-2e99-4a22-9c1b-172ccb1e7cf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:47.654240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed78b3c-2e99-4a22-9c1b-172ccb1e7cf0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:47.668946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 354/701] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:47 2022] GET /identity/v3/role_assignments?user.id=0aadba0174824781b1866da7ba39956e&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:47.670066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed78b3c-2e99-4a22-9c1b-172ccb1e7cf0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:47.694563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe491f-6505-4f58-992a-77dc629ac1de None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:47.732978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef02e2-a966-4d81-b48e-8d607431197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:47.734057 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef02e2-a966-4d81-b48e-8d607431197f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:47.734575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef02e2-a966-4d81-b48e-8d607431197f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:47.735054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef02e2-a966-4d81-b48e-8d607431197f None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:47.736022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef02e2-a966-4d81-b48e-8d607431197f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:47.736590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef02e2-a966-4d81-b48e-8d607431197f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:47.738253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef02e2-a966-4d81-b48e-8d607431197f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:47.752088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 348/702] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:47.761780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef02e2-a966-4d81-b48e-8d607431197f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:47.830736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:47.862151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed78b3c-2e99-4a22-9c1b-172ccb1e7cf0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:47.890919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:47.926258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156503-8f68-4a66-b536-27bdc7123c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:47.927237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156503-8f68-4a66-b536-27bdc7123c1e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:47.927605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156503-8f68-4a66-b536-27bdc7123c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:47.927990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156503-8f68-4a66-b536-27bdc7123c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:47.970638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef02e2-a966-4d81-b48e-8d607431197f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:48.016426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86860186-e915-4bb3-b2a6-f9a61be8e3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:48.017295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86860186-e915-4bb3-b2a6-f9a61be8e3fa None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:48.017682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86860186-e915-4bb3-b2a6-f9a61be8e3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:48.018063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86860186-e915-4bb3-b2a6-f9a61be8e3fa None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:48.018883 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86860186-e915-4bb3-b2a6-f9a61be8e3fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:48.019216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4156503-8f68-4a66-b536-27bdc7123c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:48.021395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86860186-e915-4bb3-b2a6-f9a61be8e3fa None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:48.022254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4156503-8f68-4a66-b536-27bdc7123c1e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:48.046697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 349/703] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 06:00:47 2022] POST /identity/v3/users => generated 254 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:00:48.125774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:48.133759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30fcf-c203-4a16-9d33-f97977e69322 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:48.134024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30fcf-c203-4a16-9d33-f97977e69322 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:48.134315 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30fcf-c203-4a16-9d33-f97977e69322 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:48.136063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 350/704] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:00:48.141316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91a420-0b8e-409f-99b3-bfe7be14df35 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:48.141608 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91a420-0b8e-409f-99b3-bfe7be14df35 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:48.141896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91a420-0b8e-409f-99b3-bfe7be14df35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:48.146311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 355/705] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:48.151845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156503-8f68-4a66-b536-27bdc7123c1e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:48.169284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ac91a420-0b8e-409f-99b3-bfe7be14df35 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:48.170623 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ac91a420-0b8e-409f-99b3-bfe7be14df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:48.286152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 351/706] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:48.311634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91a420-0b8e-409f-99b3-bfe7be14df35 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:48.314741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156503-8f68-4a66-b536-27bdc7123c1e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:48.355145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32573393-6552-4b3c-b853-0c864acfa3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:48.355949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32573393-6552-4b3c-b853-0c864acfa3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:48.356231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32573393-6552-4b3c-b853-0c864acfa3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:48.356507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32573393-6552-4b3c-b853-0c864acfa3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:48.362488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:48.372327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32573393-6552-4b3c-b853-0c864acfa3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:48.374044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32573393-6552-4b3c-b853-0c864acfa3a3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-32573393-6552-4b3c-b853-0c864acfa3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:48.394770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:48.396387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:48.397472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:48.397472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:48.397472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:48.397472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:48.399397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 356/707] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:48.405075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32573393-6552-4b3c-b853-0c864acfa3a3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:48.433472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91a420-0b8e-409f-99b3-bfe7be14df35 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:48.453527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:48.477819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0551842-88a8-4fab-99b0-e8951b9e61ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:48.478793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0551842-88a8-4fab-99b0-e8951b9e61ea None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:48.479182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0551842-88a8-4fab-99b0-e8951b9e61ea None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:48.479564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0551842-88a8-4fab-99b0-e8951b9e61ea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:48.480349 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0551842-88a8-4fab-99b0-e8951b9e61ea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:48.481881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0551842-88a8-4fab-99b0-e8951b9e61ea None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-d0551842-88a8-4fab-99b0-e8951b9e61ea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:48.498559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:48.499846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 06:00:48.501003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:48.503129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 352/708] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Jun 20 06:00:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:48.509201 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0551842-88a8-4fab-99b0-e8951b9e61ea None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:48.542902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32573393-6552-4b3c-b853-0c864acfa3a3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:48.584752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee727609-d9c1-4685-9e9e-43bd4189f3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:48.585724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee727609-d9c1-4685-9e9e-43bd4189f3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:48.586187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee727609-d9c1-4685-9e9e-43bd4189f3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:48.586675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee727609-d9c1-4685-9e9e-43bd4189f3b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:48.587591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee727609-d9c1-4685-9e9e-43bd4189f3b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:48.588072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee727609-d9c1-4685-9e9e-43bd4189f3b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:48.589821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee727609-d9c1-4685-9e9e-43bd4189f3b9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:48.604322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 357/709] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:48.610545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee727609-d9c1-4685-9e9e-43bd4189f3b9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:48.721801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:48.730910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee727609-d9c1-4685-9e9e-43bd4189f3b9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:48.760406 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0551842-88a8-4fab-99b0-e8951b9e61ea None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:48.768144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dc98b-8766-4272-a6e5-560c739d3f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:48.768959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:48.769436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc98b-8766-4272-a6e5-560c739d3f43 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:48.769897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc98b-8766-4272-a6e5-560c739d3f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:48.771055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc98b-8766-4272-a6e5-560c739d3f43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:48.778767 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dc98b-8766-4272-a6e5-560c739d3f43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:48.780548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dc98b-8766-4272-a6e5-560c739d3f43 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ba9dc98b-8766-4272-a6e5-560c739d3f43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:48.797914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:48.798868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:48.799771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:48.799771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:48.799771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:48.799771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:48.799771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:48.799771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:48.799771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:48.799771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:48.802950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 358/710] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:48.808172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dc98b-8766-4272-a6e5-560c739d3f43 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:48.840908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d18f81-77c1-4408-9bbd-8d0096711c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:48.841691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d18f81-77c1-4408-9bbd-8d0096711c0b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:48.841985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d18f81-77c1-4408-9bbd-8d0096711c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:48.842264 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d18f81-77c1-4408-9bbd-8d0096711c0b None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:48.842989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d18f81-77c1-4408-9bbd-8d0096711c0b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:48.843299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d18f81-77c1-4408-9bbd-8d0096711c0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:48.844826 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d18f81-77c1-4408-9bbd-8d0096711c0b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:48.858065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 353/711] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jun 20 06:00:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:48.862981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d18f81-77c1-4408-9bbd-8d0096711c0b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:48.924938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dc98b-8766-4272-a6e5-560c739d3f43 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:48.966333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909edd09-78e4-4f53-8ba1-683549da9529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:48.967333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909edd09-78e4-4f53-8ba1-683549da9529 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:48.971056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909edd09-78e4-4f53-8ba1-683549da9529 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:48.971533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909edd09-78e4-4f53-8ba1-683549da9529 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:48.972570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909edd09-78e4-4f53-8ba1-683549da9529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:48.973174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909edd09-78e4-4f53-8ba1-683549da9529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:48.975439 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909edd09-78e4-4f53-8ba1-683549da9529 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:49.003160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 359/712] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:49.007357 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909edd09-78e4-4f53-8ba1-683549da9529 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:49.047166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:49.064956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d18f81-77c1-4408-9bbd-8d0096711c0b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:49.103942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cf35a-96da-46dc-8d92-fc66df1b90c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:49.104641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cf35a-96da-46dc-8d92-fc66df1b90c3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:49.105070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cf35a-96da-46dc-8d92-fc66df1b90c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:49.105358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cf35a-96da-46dc-8d92-fc66df1b90c3 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:49.106078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cf35a-96da-46dc-8d92-fc66df1b90c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:49.106394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cf35a-96da-46dc-8d92-fc66df1b90c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:49.107783 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cf35a-96da-46dc-8d92-fc66df1b90c3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:49.115721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 354/713] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jun 20 06:00:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:49.136405 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd865d25-22cd-4c01-8f26-1cfaf0e4c29f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:49.136769 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd865d25-22cd-4c01-8f26-1cfaf0e4c29f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:49.137208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd865d25-22cd-4c01-8f26-1cfaf0e4c29f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:49.138964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 355/714] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:00:49.145739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a138-48e5-4e5b-bd0d-3e3563bd003b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:49.146117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a138-48e5-4e5b-bd0d-3e3563bd003b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:49.146287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a138-48e5-4e5b-bd0d-3e3563bd003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:49.182346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3f85a138-48e5-4e5b-bd0d-3e3563bd003b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:49.183582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3f85a138-48e5-4e5b-bd0d-3e3563bd003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:49.241084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:49.275134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909edd09-78e4-4f53-8ba1-683549da9529 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:49.316392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 356/715] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:49.328969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729fa11-675a-4267-bda2-9b0c4920f908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:49.329627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729fa11-675a-4267-bda2-9b0c4920f908 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:49.329910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729fa11-675a-4267-bda2-9b0c4920f908 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:49.330187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729fa11-675a-4267-bda2-9b0c4920f908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:49.331026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729fa11-675a-4267-bda2-9b0c4920f908 None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=3748d8369d20429eb2376ce02d42eee0) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:49.331342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729fa11-675a-4267-bda2-9b0c4920f908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:49.334056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729fa11-675a-4267-bda2-9b0c4920f908 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:49.340136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 360/716] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:49 2022] GET /identity/v3/role_assignments?user.id=3748d8369d20429eb2376ce02d42eee0&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=efc16976111d431c9173186cbd0e6c24 => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:49.353234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85a138-48e5-4e5b-bd0d-3e3563bd003b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:49.465329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85a138-48e5-4e5b-bd0d-3e3563bd003b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:49.502180 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bc3c1-ead1-42f7-b010-45b01debb12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:49.502909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bc3c1-ead1-42f7-b010-45b01debb12a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:49.503227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bc3c1-ead1-42f7-b010-45b01debb12a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:49.503733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bc3c1-ead1-42f7-b010-45b01debb12a None admin] PATH_INFO: `/v3/services/network` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:49.505286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bc3c1-ead1-42f7-b010-45b01debb12a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:49.506746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bc3c1-ead1-42f7-b010-45b01debb12a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-241bc3c1-ead1-42f7-b010-45b01debb12a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:49.519063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:49.520332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:49.521271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 357/717] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:49 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:49.526911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729fa11-675a-4267-bda2-9b0c4920f908 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:49.634342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:49.652065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729fa11-675a-4267-bda2-9b0c4920f908 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:49.693391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca771-23f5-43d2-acb4-13b10a31cc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:49.694070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca771-23f5-43d2-acb4-13b10a31cc7f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:49.694358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca771-23f5-43d2-acb4-13b10a31cc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:49.694641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca771-23f5-43d2-acb4-13b10a31cc7f None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:49.695361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca771-23f5-43d2-acb4-13b10a31cc7f None admin] RBAC: Adding query filter params (name=network) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:49.695677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca771-23f5-43d2-acb4-13b10a31cc7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:49.697143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca771-23f5-43d2-acb4-13b10a31cc7f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:49.702179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 361/718] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:00:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:49.709771 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bc3c1-ead1-42f7-b010-45b01debb12a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:49.747463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:49.825172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bc3c1-ead1-42f7-b010-45b01debb12a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:49.866591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad432f-7ad6-4a2a-bece-a73fc872aadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:49.867642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad432f-7ad6-4a2a-bece-a73fc872aadc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:49.868155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad432f-7ad6-4a2a-bece-a73fc872aadc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:49.868649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad432f-7ad6-4a2a-bece-a73fc872aadc None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:49.869575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad432f-7ad6-4a2a-bece-a73fc872aadc None admin] RBAC: Adding query filter params (type=network) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:49.870084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad432f-7ad6-4a2a-bece-a73fc872aadc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:49.871688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad432f-7ad6-4a2a-bece-a73fc872aadc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:49.877327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 358/719] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:00:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:50.311077 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179704-d01c-4de4-a1bd-ad54449b6fd5 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:50.311458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179704-d01c-4de4-a1bd-ad54449b6fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:50.311661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179704-d01c-4de4-a1bd-ad54449b6fd5 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:50.313301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 362/720] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:50.319435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6c08f-8229-460c-8ae0-311a38d94be3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:50.319892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6c08f-8229-460c-8ae0-311a38d94be3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:50.320067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6c08f-8229-460c-8ae0-311a38d94be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:50.337860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0fb6c08f-8229-460c-8ae0-311a38d94be3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:50.339066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0fb6c08f-8229-460c-8ae0-311a38d94be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:50.412586 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 359/721] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:50.437043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17179704-d01c-4de4-a1bd-ad54449b6fd5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:50.575443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17179704-d01c-4de4-a1bd-ad54449b6fd5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:50.628641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db16e5-b4b4-488b-aba7-6c692982cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:50.628641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db16e5-b4b4-488b-aba7-6c692982cf5d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:50.628641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db16e5-b4b4-488b-aba7-6c692982cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:50.628641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db16e5-b4b4-488b-aba7-6c692982cf5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:50.643724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db16e5-b4b4-488b-aba7-6c692982cf5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-77db16e5-b4b4-488b-aba7-6c692982cf5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:50.652418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:50.653401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:50.654251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 363/722] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:50.660106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6c08f-8229-460c-8ae0-311a38d94be3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:50.694537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:50.711159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607c09-3494-4168-824c-9dd38c3d9040 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:50.711482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607c09-3494-4168-824c-9dd38c3d9040 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:50.711726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607c09-3494-4168-824c-9dd38c3d9040 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:50.713290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 364/723] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:00:50.718133 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b301-0a06-4554-b720-1aac0f628855 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:50.718427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b301-0a06-4554-b720-1aac0f628855 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:50.718712 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b301-0a06-4554-b720-1aac0f628855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:50.727567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:50.744552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3f85b301-0a06-4554-b720-1aac0f628855 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:50.745798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3f85b301-0a06-4554-b720-1aac0f628855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:50.842077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6c08f-8229-460c-8ae0-311a38d94be3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:50.877449 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 365/724] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 06:00:50.901291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85b301-0a06-4554-b720-1aac0f628855 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:50.911071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515923b-5195-4fe1-b973-c79f1860b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:50.911765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515923b-5195-4fe1-b973-c79f1860b069 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:50.912050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515923b-5195-4fe1-b973-c79f1860b069 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:50.912329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515923b-5195-4fe1-b973-c79f1860b069 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:50.913127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515923b-5195-4fe1-b973-c79f1860b069 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:50.913438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515923b-5195-4fe1-b973-c79f1860b069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:50.914836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515923b-5195-4fe1-b973-c79f1860b069 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:50.936475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 360/725] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:50.940317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515923b-5195-4fe1-b973-c79f1860b069 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:51.070420 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85b301-0a06-4554-b720-1aac0f628855 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:51.092659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:51.123955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515923b-5195-4fe1-b973-c79f1860b069 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:51.143683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbadf5-f3b4-4c1e-a8b6-2a67e288a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:51.144823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbadf5-f3b4-4c1e-a8b6-2a67e288a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:51.145972 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbadf5-f3b4-4c1e-a8b6-2a67e288a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:51.146480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbadf5-f3b4-4c1e-a8b6-2a67e288a5b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:51.155362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:51.169177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbadf5-f3b4-4c1e-a8b6-2a67e288a5b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-2dfbadf5-f3b4-4c1e-a8b6-2a67e288a5b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:51.177551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:51.178568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:51.179401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:51.189812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 366/726] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:51.191214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbadf5-f3b4-4c1e-a8b6-2a67e288a5b5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:51.196884 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fed42a-c59f-4ac7-ad5e-d39a019994ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:51.197858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fed42a-c59f-4ac7-ad5e-d39a019994ea None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:51.199850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fed42a-c59f-4ac7-ad5e-d39a019994ea None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:51.200309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fed42a-c59f-4ac7-ad5e-d39a019994ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:51.224541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fed42a-c59f-4ac7-ad5e-d39a019994ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:51.227096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fed42a-c59f-4ac7-ad5e-d39a019994ea None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-27fed42a-c59f-4ac7-ad5e-d39a019994ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:51.257989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:51.259136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:51.260240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:51.260240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:51.260240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:51.260240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:51.266397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 361/727] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:51.275663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fed42a-c59f-4ac7-ad5e-d39a019994ea None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:51.356700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbadf5-f3b4-4c1e-a8b6-2a67e288a5b5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:51.411899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2a9be-43be-4776-bf27-4a76745cafa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:51.412925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2a9be-43be-4776-bf27-4a76745cafa2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:51.413359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2a9be-43be-4776-bf27-4a76745cafa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:51.413786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2a9be-43be-4776-bf27-4a76745cafa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:51.414688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2a9be-43be-4776-bf27-4a76745cafa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:51.415144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2a9be-43be-4776-bf27-4a76745cafa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:51.416718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2a9be-43be-4776-bf27-4a76745cafa2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:51.429220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 367/728] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:51.434521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2a9be-43be-4776-bf27-4a76745cafa2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:51.479606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fed42a-c59f-4ac7-ad5e-d39a019994ea None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:51.545700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:51.550344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8617b-2d0f-454a-9d18-26ab9d5253fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:51.552524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8617b-2d0f-454a-9d18-26ab9d5253fe None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:51.552998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8617b-2d0f-454a-9d18-26ab9d5253fe None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:51.554073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8617b-2d0f-454a-9d18-26ab9d5253fe None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:51.555181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8617b-2d0f-454a-9d18-26ab9d5253fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:51.556703 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8617b-2d0f-454a-9d18-26ab9d5253fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:51.559020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8617b-2d0f-454a-9d18-26ab9d5253fe None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:51.571135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:51.589504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 362/729] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:51.590632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8617b-2d0f-454a-9d18-26ab9d5253fe None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:51.645044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2a9be-43be-4776-bf27-4a76745cafa2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:51.712878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35cc0-7bc5-4f43-8622-7e2ab738c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:51.713936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35cc0-7bc5-4f43-8622-7e2ab738c5ca None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:51.714376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35cc0-7bc5-4f43-8622-7e2ab738c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:51.714799 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35cc0-7bc5-4f43-8622-7e2ab738c5ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:51.727413 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb35cc0-7bc5-4f43-8622-7e2ab738c5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:51.729222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb35cc0-7bc5-4f43-8622-7e2ab738c5ca None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-fbb35cc0-7bc5-4f43-8622-7e2ab738c5ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:51.749061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:51.750255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:51.751402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:51.751402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:51.751402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:51.751402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:51.753846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 368/730] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:51.765735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35cc0-7bc5-4f43-8622-7e2ab738c5ca None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:51.783883 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8617b-2d0f-454a-9d18-26ab9d5253fe None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:51.837343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc5c3d-db7e-43fb-9d2d-150c877d70e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:51.838167 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc5c3d-db7e-43fb-9d2d-150c877d70e2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:51.838517 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc5c3d-db7e-43fb-9d2d-150c877d70e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:51.838733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc5c3d-db7e-43fb-9d2d-150c877d70e2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:51.854721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc5c3d-db7e-43fb-9d2d-150c877d70e2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:51.855972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc5c3d-db7e-43fb-9d2d-150c877d70e2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-8ebc5c3d-db7e-43fb-9d2d-150c877d70e2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:51.876177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:51.877480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:51.878643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:51.878643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:51.878643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:51.878643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:51.878643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:51.878643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:51.878643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:51.878643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:51.878643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:00:51.878643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:51.882285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 363/731] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:51.883698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57a8e1-f9c3-428a-a75a-a57babb16a4c None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:51.883941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57a8e1-f9c3-428a-a75a-a57babb16a4c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:51.884229 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57a8e1-f9c3-428a-a75a-a57babb16a4c None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:51.885823 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 364/732] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:51.886534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57a8e1-f9c3-428a-a75a-a57babb16a4c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:51.902539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb35cc0-7bc5-4f43-8622-7e2ab738c5ca None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:51.912602 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:51.943826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a83495-dce8-4d4d-8ce0-4e523e6ae4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:51.944897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a83495-dce8-4d4d-8ce0-4e523e6ae4eb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:51.945533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a83495-dce8-4d4d-8ce0-4e523e6ae4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:51.945995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a83495-dce8-4d4d-8ce0-4e523e6ae4eb None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:51.946970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a83495-dce8-4d4d-8ce0-4e523e6ae4eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:51.947460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a83495-dce8-4d4d-8ce0-4e523e6ae4eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:51.949108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a83495-dce8-4d4d-8ce0-4e523e6ae4eb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:51.952141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:51.961866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 369/733] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:51.966613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d21d-073a-4ec8-9c54-ff7546022019 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:51.966913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d21d-073a-4ec8-9c54-ff7546022019 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:51.967197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76d21d-073a-4ec8-9c54-ff7546022019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:51.983270 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8b76d21d-073a-4ec8-9c54-ff7546022019 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:51.984464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8b76d21d-073a-4ec8-9c54-ff7546022019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:52.002351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57a8e1-f9c3-428a-a75a-a57babb16a4c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:52.040001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f903b-d0ee-4bd7-a154-4b9e6f1f4397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:52.040708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f903b-d0ee-4bd7-a154-4b9e6f1f4397 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.041003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f903b-d0ee-4bd7-a154-4b9e6f1f4397 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.041285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f903b-d0ee-4bd7-a154-4b9e6f1f4397 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.042133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f903b-d0ee-4bd7-a154-4b9e6f1f4397 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:52.042449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f903b-d0ee-4bd7-a154-4b9e6f1f4397 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:52.043897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f903b-d0ee-4bd7-a154-4b9e6f1f4397 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:52.068635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 365/734] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jun 20 06:00:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:52.068635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdee5f-e246-442e-9615-526638dbee81 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.068635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdee5f-e246-442e-9615-526638dbee81 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.068635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdee5f-e246-442e-9615-526638dbee81 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.068635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 366/735] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:52.068635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdee5f-e246-442e-9615-526638dbee81 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:52.069217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 370/736] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:52.070644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76d21d-073a-4ec8-9c54-ff7546022019 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:52.179340 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:52.181674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdee5f-e246-442e-9615-526638dbee81 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:52.183223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76d21d-073a-4ec8-9c54-ff7546022019 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:52.198746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:52.220835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a9b0a-03e3-4ed3-a772-330587ba2242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:52.221250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349f9b2-000e-4a16-880b-742fccb6d1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:52.221649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a9b0a-03e3-4ed3-a772-330587ba2242 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.221909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349f9b2-000e-4a16-880b-742fccb6d1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.222034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a9b0a-03e3-4ed3-a772-330587ba2242 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.222219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349f9b2-000e-4a16-880b-742fccb6d1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.222324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a9b0a-03e3-4ed3-a772-330587ba2242 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.222488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349f9b2-000e-4a16-880b-742fccb6d1e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.229795 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a9b0a-03e3-4ed3-a772-330587ba2242 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:52.231255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a9b0a-03e3-4ed3-a772-330587ba2242 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f26a9b0a-03e3-4ed3-a772-330587ba2242 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:52.247005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:52.247980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:52.249347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:52.249347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:52.249347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:52.249347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:52.249347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:52.249347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:52.249347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:52.249347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:52.249347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:00:52.249347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:52.249347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 367/737] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jun 20 06:00:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:52.249957 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c75d9b-346e-4c60-8fb1-50d74d93b941 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.250281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c75d9b-346e-4c60-8fb1-50d74d93b941 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.250390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c75d9b-346e-4c60-8fb1-50d74d93b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.267799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d6c75d9b-346e-4c60-8fb1-50d74d93b941 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:52.269034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d6c75d9b-346e-4c60-8fb1-50d74d93b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:52.299278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349f9b2-000e-4a16-880b-742fccb6d1e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:52.300948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349f9b2-000e-4a16-880b-742fccb6d1e1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:52.342673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 368/738] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:52.343550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c75d9b-346e-4c60-8fb1-50d74d93b941 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:52.418330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:52.423128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 371/739] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:52.425466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349f9b2-000e-4a16-880b-742fccb6d1e1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:52.452532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c75d9b-346e-4c60-8fb1-50d74d93b941 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:52.454758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:52.487344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738efad0-425c-4288-b5e1-db95601f8cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:52.488145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738efad0-425c-4288-b5e1-db95601f8cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.488494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738efad0-425c-4288-b5e1-db95601f8cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.489430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738efad0-425c-4288-b5e1-db95601f8cd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.499840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738efad0-425c-4288-b5e1-db95601f8cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-738efad0-425c-4288-b5e1-db95601f8cd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:52.507637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:52.508568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:52.509453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:52.512900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 369/740] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:52.513851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738efad0-425c-4288-b5e1-db95601f8cd7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:52.523991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349f9b2-000e-4a16-880b-742fccb6d1e1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:52.558408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef69e3e-2975-4bf0-8857-392c8e2188f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:52.559076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef69e3e-2975-4bf0-8857-392c8e2188f8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.559364 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef69e3e-2975-4bf0-8857-392c8e2188f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.559640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef69e3e-2975-4bf0-8857-392c8e2188f8 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.560472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef69e3e-2975-4bf0-8857-392c8e2188f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:52.560810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef69e3e-2975-4bf0-8857-392c8e2188f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:52.562235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef69e3e-2975-4bf0-8857-392c8e2188f8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:52.578876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 372/741] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jun 20 06:00:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:52.580101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f13a2-ca5b-47fd-a92e-6328d63cfd37 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.580386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f13a2-ca5b-47fd-a92e-6328d63cfd37 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.580697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f13a2-ca5b-47fd-a92e-6328d63cfd37 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.581929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 373/742] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:52.583482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f13a2-ca5b-47fd-a92e-6328d63cfd37 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:52.617370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738efad0-425c-4288-b5e1-db95601f8cd7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:52.642206 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:52.654789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801499d-85d2-47cb-a454-75c62070ba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:52.655455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801499d-85d2-47cb-a454-75c62070ba24 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.655747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801499d-85d2-47cb-a454-75c62070ba24 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.656031 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801499d-85d2-47cb-a454-75c62070ba24 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.656779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801499d-85d2-47cb-a454-75c62070ba24 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:52.658174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801499d-85d2-47cb-a454-75c62070ba24 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:52.672549 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 370/743] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 06:00:52 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:00:52.673376 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801499d-85d2-47cb-a454-75c62070ba24 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:52.702435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:52.708772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f13a2-ca5b-47fd-a92e-6328d63cfd37 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:52.747329 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad248242-a187-49eb-9527-ce2b26e6dc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:52.748201 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad248242-a187-49eb-9527-ce2b26e6dc41 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.748490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad248242-a187-49eb-9527-ce2b26e6dc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.748798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad248242-a187-49eb-9527-ce2b26e6dc41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.761502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad248242-a187-49eb-9527-ce2b26e6dc41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:52.763002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad248242-a187-49eb-9527-ce2b26e6dc41 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ad248242-a187-49eb-9527-ce2b26e6dc41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:52.782421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:52.783699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:52.784903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:52.784903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:52.784903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:52.784903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:52.784903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 374/744] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:52.784903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad248242-a187-49eb-9527-ce2b26e6dc41 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:52.808588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801499d-85d2-47cb-a454-75c62070ba24 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:52.846911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6b3aa-d214-4e7e-99a5-28f1d66c4cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:52.847747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6b3aa-d214-4e7e-99a5-28f1d66c4cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.848084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6b3aa-d214-4e7e-99a5-28f1d66c4cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.849524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6b3aa-d214-4e7e-99a5-28f1d66c4cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.850298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6b3aa-d214-4e7e-99a5-28f1d66c4cb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:52.850610 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6b3aa-d214-4e7e-99a5-28f1d66c4cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:52.852057 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6b3aa-d214-4e7e-99a5-28f1d66c4cb3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:52.861665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 371/745] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:52.862925 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d22e-fe57-4c8c-b59d-c56d39320860 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.863218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d22e-fe57-4c8c-b59d-c56d39320860 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.863497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d22e-fe57-4c8c-b59d-c56d39320860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.881719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-77c1d22e-fe57-4c8c-b59d-c56d39320860 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:52.882912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-77c1d22e-fe57-4c8c-b59d-c56d39320860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:52.901249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad248242-a187-49eb-9527-ce2b26e6dc41 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:52.903574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:52.937700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77379e-e73d-4433-89f0-a15361d069c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:52.938360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77379e-e73d-4433-89f0-a15361d069c0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:52.938648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77379e-e73d-4433-89f0-a15361d069c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:52.938930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77379e-e73d-4433-89f0-a15361d069c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:52.956814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 372/746] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 06:00:52.956814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d22e-fe57-4c8c-b59d-c56d39320860 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:52.984555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:53.013195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77379e-e73d-4433-89f0-a15361d069c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:53.014666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77379e-e73d-4433-89f0-a15361d069c0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:53.074695 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d22e-fe57-4c8c-b59d-c56d39320860 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:53.116267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b27caf-ad49-435d-8aaa-3e16d0fe6a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:53.121091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b27caf-ad49-435d-8aaa-3e16d0fe6a4c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:53.121233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 375/747] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:00:52 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 06:00:53.121433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b27caf-ad49-435d-8aaa-3e16d0fe6a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:53.121433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b27caf-ad49-435d-8aaa-3e16d0fe6a4c None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:53.121579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77379e-e73d-4433-89f0-a15361d069c0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:53.121650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b27caf-ad49-435d-8aaa-3e16d0fe6a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:53.121650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b27caf-ad49-435d-8aaa-3e16d0fe6a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:53.121650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b27caf-ad49-435d-8aaa-3e16d0fe6a4c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:53.123283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:53.135178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 373/748] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:53.136008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b27caf-ad49-435d-8aaa-3e16d0fe6a4c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:53.234004 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:53.239967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77379e-e73d-4433-89f0-a15361d069c0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:53.258523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b27caf-ad49-435d-8aaa-3e16d0fe6a4c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:53.282867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75efb24-4364-4c62-9c44-a1df1325fde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:53.283869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75efb24-4364-4c62-9c44-a1df1325fde4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:53.284427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75efb24-4364-4c62-9c44-a1df1325fde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:53.285035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75efb24-4364-4c62-9c44-a1df1325fde4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:53.292871 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1236da-964b-4e93-b662-2453bcd1d276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:53.293545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1236da-964b-4e93-b662-2453bcd1d276 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:53.293888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1236da-964b-4e93-b662-2453bcd1d276 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:53.294178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1236da-964b-4e93-b662-2453bcd1d276 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:53.294908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1236da-964b-4e93-b662-2453bcd1d276 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:53.296293 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1236da-964b-4e93-b662-2453bcd1d276 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:53.298039 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75efb24-4364-4c62-9c44-a1df1325fde4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:53.300356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75efb24-4364-4c62-9c44-a1df1325fde4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:53.320649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 374/749] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 06:00:53 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:00:53.320649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1236da-964b-4e93-b662-2453bcd1d276 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e75efb24-4364-4c62-9c44-a1df1325fde4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:53.330186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:53.331194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:53.332168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:53.332168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:53.332168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:53.332168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:53.332168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 376/750] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:53.334205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75efb24-4364-4c62-9c44-a1df1325fde4 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:53.408329 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:53.467573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1236da-964b-4e93-b662-2453bcd1d276 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:53.478815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75efb24-4364-4c62-9c44-a1df1325fde4 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:53.504276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:53.514263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a16563-db93-4213-8fef-1436b5b5515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:53.515140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a16563-db93-4213-8fef-1436b5b5515a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:53.515423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a16563-db93-4213-8fef-1436b5b5515a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:53.515748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a16563-db93-4213-8fef-1436b5b5515a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:53.524026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1849b5-9da7-413d-9a37-996045daee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:53.524876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1849b5-9da7-413d-9a37-996045daee33 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:53.525169 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1849b5-9da7-413d-9a37-996045daee33 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:53.525452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1849b5-9da7-413d-9a37-996045daee33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:53.528252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a16563-db93-4213-8fef-1436b5b5515a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:53.529776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a16563-db93-4213-8fef-1436b5b5515a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:53.533697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1849b5-9da7-413d-9a37-996045daee33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:53.535396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1849b5-9da7-413d-9a37-996045daee33 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-13a16563-db93-4213-8fef-1436b5b5515a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:53.549245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:53.550205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:53.551656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:53.551656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:53.551656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:53.551656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:53.555647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 375/751] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:53.555647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a16563-db93-4213-8fef-1436b5b5515a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-cb1849b5-9da7-413d-9a37-996045daee33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:53.555858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:53.556705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:53.558258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:53.558258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:53.558258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:53.558258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:53.558258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:53.558258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:53.558258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:53.558258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:53.558258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 377/752] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:53.561758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1849b5-9da7-413d-9a37-996045daee33 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:53.673889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1849b5-9da7-413d-9a37-996045daee33 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:53.691360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:53.702076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a16563-db93-4213-8fef-1436b5b5515a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:53.711474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda44c40-a121-4462-9159-89c11d1bf2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:53.712145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda44c40-a121-4462-9159-89c11d1bf2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:53.712432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda44c40-a121-4462-9159-89c11d1bf2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:53.712773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda44c40-a121-4462-9159-89c11d1bf2a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:53.713612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda44c40-a121-4462-9159-89c11d1bf2a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:53.713928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda44c40-a121-4462-9159-89c11d1bf2a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:53.715388 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda44c40-a121-4462-9159-89c11d1bf2a5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:53.729356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 378/753] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:53.730286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda44c40-a121-4462-9159-89c11d1bf2a5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:53.752357 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc69ea-ebfa-40ab-913d-9f07a33ad662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:53.753968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc69ea-ebfa-40ab-913d-9f07a33ad662 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:53.754876 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc69ea-ebfa-40ab-913d-9f07a33ad662 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:53.755381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc69ea-ebfa-40ab-913d-9f07a33ad662 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:53.757025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc69ea-ebfa-40ab-913d-9f07a33ad662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:53.757867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc69ea-ebfa-40ab-913d-9f07a33ad662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:53.760138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc69ea-ebfa-40ab-913d-9f07a33ad662 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:53.777850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 376/754] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:53.779577 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc69ea-ebfa-40ab-913d-9f07a33ad662 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:53.839075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda44c40-a121-4462-9159-89c11d1bf2a5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:53.855976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:53.892494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90c28-c709-4330-b520-f05925d83b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:53.893642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90c28-c709-4330-b520-f05925d83b4f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:53.893961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90c28-c709-4330-b520-f05925d83b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:53.894246 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90c28-c709-4330-b520-f05925d83b4f None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:53.895868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca90c28-c709-4330-b520-f05925d83b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:53.896521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca90c28-c709-4330-b520-f05925d83b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:53.898003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca90c28-c709-4330-b520-f05925d83b4f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:53.913748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 379/755] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:53.914746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90c28-c709-4330-b520-f05925d83b4f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:53.922636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc69ea-ebfa-40ab-913d-9f07a33ad662 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:53.959855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:53.967045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d32d07-76ac-4b39-b7a9-7c68d525ad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:53.968937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d32d07-76ac-4b39-b7a9-7c68d525ad60 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:53.969443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d32d07-76ac-4b39-b7a9-7c68d525ad60 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:53.970336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d32d07-76ac-4b39-b7a9-7c68d525ad60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:53.971709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d32d07-76ac-4b39-b7a9-7c68d525ad60 None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=0aadba0174824781b1866da7ba39956e) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:53.972263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d32d07-76ac-4b39-b7a9-7c68d525ad60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:53.975117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d32d07-76ac-4b39-b7a9-7c68d525ad60 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:53.989569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 377/756] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:53 2022] GET /identity/v3/role_assignments?user.id=0aadba0174824781b1866da7ba39956e&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=efc16976111d431c9173186cbd0e6c24 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:53.989569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d32d07-76ac-4b39-b7a9-7c68d525ad60 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:54.084265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90c28-c709-4330-b520-f05925d83b4f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:54.124514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366ece0-4067-4dc7-a35b-dd2a490bda82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:54.125890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366ece0-4067-4dc7-a35b-dd2a490bda82 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:54.126396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366ece0-4067-4dc7-a35b-dd2a490bda82 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:54.126907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366ece0-4067-4dc7-a35b-dd2a490bda82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:54.135516 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366ece0-4067-4dc7-a35b-dd2a490bda82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:54.137353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366ece0-4067-4dc7-a35b-dd2a490bda82 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4366ece0-4067-4dc7-a35b-dd2a490bda82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:54.153675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:54.154816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:54.155808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:54.155808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:54.155808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:54.155808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:54.155808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:54.155808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:54.155808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:54.155808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:54.155808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:54.155808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:54.158599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 380/757] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jun 20 06:00:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:54.167974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d32d07-76ac-4b39-b7a9-7c68d525ad60 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:54.169345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366ece0-4067-4dc7-a35b-dd2a490bda82 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:54.185654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:54.206225 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106de16-32de-4d46-9bab-67d6ad48d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:54.207284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106de16-32de-4d46-9bab-67d6ad48d2ee None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:54.207632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106de16-32de-4d46-9bab-67d6ad48d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:54.207841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106de16-32de-4d46-9bab-67d6ad48d2ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:54.217072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106de16-32de-4d46-9bab-67d6ad48d2ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:54.217072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106de16-32de-4d46-9bab-67d6ad48d2ee None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-1106de16-32de-4d46-9bab-67d6ad48d2ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:54.233249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:54.234244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:54.235169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:54.235169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:54.235169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:54.235169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:54.235169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:54.235169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:54.235169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:54.235169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:54.235169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 378/758] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:54.240831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106de16-32de-4d46-9bab-67d6ad48d2ee None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:54.320950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366ece0-4067-4dc7-a35b-dd2a490bda82 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:54.329001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:54.354585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106de16-32de-4d46-9bab-67d6ad48d2ee None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:54.360650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed6412-4fb4-4bb3-bb50-9b6d7cb2565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:54.361644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed6412-4fb4-4bb3-bb50-9b6d7cb2565f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:54.362140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed6412-4fb4-4bb3-bb50-9b6d7cb2565f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:54.362623 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed6412-4fb4-4bb3-bb50-9b6d7cb2565f None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:54.363703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed6412-4fb4-4bb3-bb50-9b6d7cb2565f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:54.364275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed6412-4fb4-4bb3-bb50-9b6d7cb2565f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:54.366126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed6412-4fb4-4bb3-bb50-9b6d7cb2565f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:54.386339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 381/759] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jun 20 06:00:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:54.393908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed6412-4fb4-4bb3-bb50-9b6d7cb2565f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:54.398485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e733258-2ebb-4b3f-bd6b-d8fff5a95f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:54.399171 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733258-2ebb-4b3f-bd6b-d8fff5a95f76 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:54.399459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733258-2ebb-4b3f-bd6b-d8fff5a95f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:54.399742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733258-2ebb-4b3f-bd6b-d8fff5a95f76 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:54.400548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e733258-2ebb-4b3f-bd6b-d8fff5a95f76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:54.400893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e733258-2ebb-4b3f-bd6b-d8fff5a95f76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:54.402941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e733258-2ebb-4b3f-bd6b-d8fff5a95f76 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:54.424816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 379/760] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:54.433064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e733258-2ebb-4b3f-bd6b-d8fff5a95f76 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:54.486281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:54.600881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed6412-4fb4-4bb3-bb50-9b6d7cb2565f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:54.635819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e733258-2ebb-4b3f-bd6b-d8fff5a95f76 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:54.674060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e2fee-e69f-477e-aa5b-f259ff28b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:54.674873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e2fee-e69f-477e-aa5b-f259ff28b700 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:54.675162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e2fee-e69f-477e-aa5b-f259ff28b700 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:54.675445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e2fee-e69f-477e-aa5b-f259ff28b700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:54.693024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df454da-f3c0-4720-a4f1-d36f3cc38e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:54.693502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e2fee-e69f-477e-aa5b-f259ff28b700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:54.693687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df454da-f3c0-4720-a4f1-d36f3cc38e82 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:54.693928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df454da-f3c0-4720-a4f1-d36f3cc38e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:54.694207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df454da-f3c0-4720-a4f1-d36f3cc38e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:54.694962 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e2fee-e69f-477e-aa5b-f259ff28b700 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:54.695070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df454da-f3c0-4720-a4f1-d36f3cc38e82 None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=6c8e272684d542caaaecce191467edc6) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:54.695393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df454da-f3c0-4720-a4f1-d36f3cc38e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:54.696805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df454da-f3c0-4720-a4f1-d36f3cc38e82 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:54.703225 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 380/761] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:00:54 2022] GET /identity/v3/role_assignments?user.id=6c8e272684d542caaaecce191467edc6&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-219e2fee-e69f-477e-aa5b-f259ff28b700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:54.720158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:54.721573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:54.722489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:54.722489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:54.722489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:54.722489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:54.722489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 382/762] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:54.727529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df454da-f3c0-4720-a4f1-d36f3cc38e82 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:54.859279 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df454da-f3c0-4720-a4f1-d36f3cc38e82 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:54.860929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:54.901793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bd765-d894-430b-bdb1-25ef3929642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:54.902441 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd765-d894-430b-bdb1-25ef3929642f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:54.902742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd765-d894-430b-bdb1-25ef3929642f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:54.903023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd765-d894-430b-bdb1-25ef3929642f None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:54.903762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bd765-d894-430b-bdb1-25ef3929642f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:54.904077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bd765-d894-430b-bdb1-25ef3929642f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:54.905494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bd765-d894-430b-bdb1-25ef3929642f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:54.919988 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 381/763] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:54.924979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e2fee-e69f-477e-aa5b-f259ff28b700 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:54.937660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:55.027483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223683c-e2ef-43d6-a890-874b41e893e7 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.027809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223683c-e2ef-43d6-a890-874b41e893e7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.028062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223683c-e2ef-43d6-a890-874b41e893e7 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.029652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 382/764] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:55.037758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7682dbc-fd4d-49c9-a220-92b3147e7705 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.037758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7682dbc-fd4d-49c9-a220-92b3147e7705 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.037758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7682dbc-fd4d-49c9-a220-92b3147e7705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.066666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a7682dbc-fd4d-49c9-a220-92b3147e7705 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:55.067943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a7682dbc-fd4d-49c9-a220-92b3147e7705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:55.072466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e2fee-e69f-477e-aa5b-f259ff28b700 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:55.109509 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc93ff-a788-4a5b-9978-6ac5c205a8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:55.110663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc93ff-a788-4a5b-9978-6ac5c205a8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.111157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc93ff-a788-4a5b-9978-6ac5c205a8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.111636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc93ff-a788-4a5b-9978-6ac5c205a8a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.119240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc93ff-a788-4a5b-9978-6ac5c205a8a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:55.121023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc93ff-a788-4a5b-9978-6ac5c205a8a3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-3fdc93ff-a788-4a5b-9978-6ac5c205a8a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:55.135643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:55.136571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:55.137518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:55.137518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:55.137518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:55.137518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:55.137518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:55.137518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:55.137518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:55.137518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:55.139986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 383/765] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:55.148107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc93ff-a788-4a5b-9978-6ac5c205a8a3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:55.196937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 383/766] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:00:55.224593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7682dbc-fd4d-49c9-a220-92b3147e7705 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:55.273463 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:55.331786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc93ff-a788-4a5b-9978-6ac5c205a8a3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:55.375441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19894957-348b-42d3-baa5-84b22819871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:55.376113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19894957-348b-42d3-baa5-84b22819871f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.376392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19894957-348b-42d3-baa5-84b22819871f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.376696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19894957-348b-42d3-baa5-84b22819871f None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.377488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19894957-348b-42d3-baa5-84b22819871f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:55.377793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19894957-348b-42d3-baa5-84b22819871f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:55.379746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19894957-348b-42d3-baa5-84b22819871f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:55.403056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:55.412020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 384/767] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:55.417648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19894957-348b-42d3-baa5-84b22819871f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:55.432329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7682dbc-fd4d-49c9-a220-92b3147e7705 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:55.469255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1ec0e-5313-4cc1-87bb-fd2fa6e9ca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:55.470013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1ec0e-5313-4cc1-87bb-fd2fa6e9ca3d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.470297 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1ec0e-5313-4cc1-87bb-fd2fa6e9ca3d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.470571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1ec0e-5313-4cc1-87bb-fd2fa6e9ca3d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.471252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1ec0e-5313-4cc1-87bb-fd2fa6e9ca3d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:55.472733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1ec0e-5313-4cc1-87bb-fd2fa6e9ca3d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-bfe1ec0e-5313-4cc1-87bb-fd2fa6e9ca3d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:55.488037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:55.489684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 06:00:55.490544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:55.491355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 384/768] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Jun 20 06:00:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:55.497839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1ec0e-5313-4cc1-87bb-fd2fa6e9ca3d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:55.608658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19894957-348b-42d3-baa5-84b22819871f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:55.637352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:55.653373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f0aff-61c1-45b8-83d2-b86d3ca71b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:55.654323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0aff-61c1-45b8-83d2-b86d3ca71b56 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.654613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0aff-61c1-45b8-83d2-b86d3ca71b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.654893 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0aff-61c1-45b8-83d2-b86d3ca71b56 None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/3748d8369d20429eb2376ce02d42eee0/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.658068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f0aff-61c1-45b8-83d2-b86d3ca71b56 None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=3748d8369d20429eb2376ce02d42eee0, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:55.661217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f0aff-61c1-45b8-83d2-b86d3ca71b56 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:55.681702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1ec0e-5313-4cc1-87bb-fd2fa6e9ca3d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:55.683403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 385/769] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:00:55 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/3748d8369d20429eb2376ce02d42eee0/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:55.716187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32da6bb-82b3-406f-93ee-a5adabee1fdd None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.716498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32da6bb-82b3-406f-93ee-a5adabee1fdd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.716825 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32da6bb-82b3-406f-93ee-a5adabee1fdd None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.718342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 386/770] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:00:55.724326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519802ee-812a-4ead-a588-a77d08195c21 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.725534 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519802ee-812a-4ead-a588-a77d08195c21 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.726031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519802ee-812a-4ead-a588-a77d08195c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.743834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bc7dd-8df9-4d56-996a-719ea3b85224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:55.745002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bc7dd-8df9-4d56-996a-719ea3b85224 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.747298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bc7dd-8df9-4d56-996a-719ea3b85224 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.747841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bc7dd-8df9-4d56-996a-719ea3b85224 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.748893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bc7dd-8df9-4d56-996a-719ea3b85224 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:55.749801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bc7dd-8df9-4d56-996a-719ea3b85224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:55.753691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bc7dd-8df9-4d56-996a-719ea3b85224 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:55.758265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-519802ee-812a-4ead-a588-a77d08195c21 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:55.760709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-519802ee-812a-4ead-a588-a77d08195c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:55.764136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 385/771] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jun 20 06:00:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:55.771328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bc7dd-8df9-4d56-996a-719ea3b85224 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:55.792971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:55.899011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 387/772] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:00:55.925175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519802ee-812a-4ead-a588-a77d08195c21 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:55.939317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bc7dd-8df9-4d56-996a-719ea3b85224 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:55.993462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f9faf-6136-4a32-9c80-27cd973672c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:55.994655 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f9faf-6136-4a32-9c80-27cd973672c9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.995376 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f9faf-6136-4a32-9c80-27cd973672c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.995834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f9faf-6136-4a32-9c80-27cd973672c9 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.997470 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f9faf-6136-4a32-9c80-27cd973672c9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:55.998120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f9faf-6136-4a32-9c80-27cd973672c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:56.000577 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f9faf-6136-4a32-9c80-27cd973672c9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:56.011075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 386/773] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jun 20 06:00:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:56.017707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f9faf-6136-4a32-9c80-27cd973672c9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:56.059630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519802ee-812a-4ead-a588-a77d08195c21 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:56.085472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:56.126396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e5878-e214-4523-8dca-85a14270a602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:56.128879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5878-e214-4523-8dca-85a14270a602 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:56.129428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5878-e214-4523-8dca-85a14270a602 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:56.130179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5878-e214-4523-8dca-85a14270a602 None admin] PATH_INFO: `/v3/services/network` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:56.132763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e5878-e214-4523-8dca-85a14270a602 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:56.135729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e5878-e214-4523-8dca-85a14270a602 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-398e5878-e214-4523-8dca-85a14270a602 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:56.164781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:56.165873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 06:00:56.166726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:56.174415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 388/774] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:55 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:56.177867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:56.180870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e5878-e214-4523-8dca-85a14270a602 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:56.208556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f9faf-6136-4a32-9c80-27cd973672c9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:56.250976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e36197-2352-420a-877c-66ff09a4f857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:56.251567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e36197-2352-420a-877c-66ff09a4f857 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:56.251856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e36197-2352-420a-877c-66ff09a4f857 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:56.252136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e36197-2352-420a-877c-66ff09a4f857 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:56.253000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e36197-2352-420a-877c-66ff09a4f857 None admin] RBAC: Adding query filter params (interface=public, service_id=fd937e1a8d474dcba3c83029f006a4d9, region_id=RegionOne) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:56.253322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e36197-2352-420a-877c-66ff09a4f857 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:56.255251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e36197-2352-420a-877c-66ff09a4f857 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:56.273471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 387/775] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jun 20 06:00:56 2022] GET /identity/v3/endpoints?service_id=fd937e1a8d474dcba3c83029f006a4d9&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:56.279734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e36197-2352-420a-877c-66ff09a4f857 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:56.362298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e5878-e214-4523-8dca-85a14270a602 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:56.415020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8bd2-d46a-4a01-bbe3-2b2992e0ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:56.415744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8bd2-d46a-4a01-bbe3-2b2992e0ddcc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:56.416037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8bd2-d46a-4a01-bbe3-2b2992e0ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:56.416324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8bd2-d46a-4a01-bbe3-2b2992e0ddcc None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:56.417070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca8bd2-d46a-4a01-bbe3-2b2992e0ddcc None admin] RBAC: Adding query filter params (name=network) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:56.417383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca8bd2-d46a-4a01-bbe3-2b2992e0ddcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:56.418786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca8bd2-d46a-4a01-bbe3-2b2992e0ddcc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:56.428800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 389/776] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:00:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:56.433517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8bd2-d46a-4a01-bbe3-2b2992e0ddcc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:56.434386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e36197-2352-420a-877c-66ff09a4f857 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:56.495888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881be654-e6c6-45aa-83bc-c485c6c3456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:56.496565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881be654-e6c6-45aa-83bc-c485c6c3456b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:56.496881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881be654-e6c6-45aa-83bc-c485c6c3456b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:56.497211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881be654-e6c6-45aa-83bc-c485c6c3456b None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:56.497905 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881be654-e6c6-45aa-83bc-c485c6c3456b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:56.500081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881be654-e6c6-45aa-83bc-c485c6c3456b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:56.512564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 388/777] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jun 20 06:00:56 2022] GET /identity/v3/services => generated 772 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:56.520464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:56.587775 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd32821-ca48-4cd5-adfc-a2889e6f09f6 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:56.588139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd32821-ca48-4cd5-adfc-a2889e6f09f6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:56.588338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd32821-ca48-4cd5-adfc-a2889e6f09f6 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:56.589798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 389/778] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:00:56.600813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d1a73-7c87-45a7-a8c7-362a9c3efa98 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:56.601126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d1a73-7c87-45a7-a8c7-362a9c3efa98 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:56.601373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d1a73-7c87-45a7-a8c7-362a9c3efa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:56.606869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:56.634698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-387d1a73-7c87-45a7-a8c7-362a9c3efa98 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:56.636051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-387d1a73-7c87-45a7-a8c7-362a9c3efa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:56.649495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8bd2-d46a-4a01-bbe3-2b2992e0ddcc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:56.717558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299d075-27b5-4dc5-9b9c-bce91aeff23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:56.718237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d075-27b5-4dc5-9b9c-bce91aeff23c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:56.718528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d075-27b5-4dc5-9b9c-bce91aeff23c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:56.718811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d075-27b5-4dc5-9b9c-bce91aeff23c None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:56.719531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d075-27b5-4dc5-9b9c-bce91aeff23c None admin] RBAC: Adding query filter params (type=network) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:56.719967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d075-27b5-4dc5-9b9c-bce91aeff23c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:56.721427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d075-27b5-4dc5-9b9c-bce91aeff23c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:56.729799 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 390/779] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:00:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:56.737370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299d075-27b5-4dc5-9b9c-bce91aeff23c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:56.741382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 390/780] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:00:56.771009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d1a73-7c87-45a7-a8c7-362a9c3efa98 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:56.843861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299d075-27b5-4dc5-9b9c-bce91aeff23c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:56.855310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:56.881659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d1a73-7c87-45a7-a8c7-362a9c3efa98 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:56.882740 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f854a-443c-4532-8768-af34079e436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:56.883538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f854a-443c-4532-8768-af34079e436e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:56.883985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f854a-443c-4532-8768-af34079e436e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:56.884361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f854a-443c-4532-8768-af34079e436e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:56.885262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f854a-443c-4532-8768-af34079e436e None admin] RBAC: Adding query filter params (interface=public, service_id=74b07d6b42994a3ca97ee34bd66be293, region_id=RegionOne) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:56.885651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f854a-443c-4532-8768-af34079e436e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:56.887128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f854a-443c-4532-8768-af34079e436e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:56.895739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 391/781] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jun 20 06:00:56 2022] GET /identity/v3/endpoints?service_id=74b07d6b42994a3ca97ee34bd66be293&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:56.915893 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f854a-443c-4532-8768-af34079e436e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:56.918179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:56.933338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed762f3e-76a1-468b-aa9a-0a1864451865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:56.934150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed762f3e-76a1-468b-aa9a-0a1864451865 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:56.934493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed762f3e-76a1-468b-aa9a-0a1864451865 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:56.934775 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed762f3e-76a1-468b-aa9a-0a1864451865 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:56.953689 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed762f3e-76a1-468b-aa9a-0a1864451865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ed762f3e-76a1-468b-aa9a-0a1864451865 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:56.967163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:56.968166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:56.969056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:56.971752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 391/782] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:56.979161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed762f3e-76a1-468b-aa9a-0a1864451865 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:57.090303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f854a-443c-4532-8768-af34079e436e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:57.127302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed762f3e-76a1-468b-aa9a-0a1864451865 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:57.160037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf83c40-87de-4dad-af5d-06ee729bf09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:57.160998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf83c40-87de-4dad-af5d-06ee729bf09f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.163734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf83c40-87de-4dad-af5d-06ee729bf09f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.163734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf83c40-87de-4dad-af5d-06ee729bf09f None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.163734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf83c40-87de-4dad-af5d-06ee729bf09f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:57.163734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf83c40-87de-4dad-af5d-06ee729bf09f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:57.175364 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 392/783] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jun 20 06:00:56 2022] GET /identity/v3/services => generated 772 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:57.196558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6b4a9-fb8e-46a8-b23e-7abc3bc47be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:57.197283 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b4a9-fb8e-46a8-b23e-7abc3bc47be3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.197574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b4a9-fb8e-46a8-b23e-7abc3bc47be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.197860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b4a9-fb8e-46a8-b23e-7abc3bc47be3 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.198649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b4a9-fb8e-46a8-b23e-7abc3bc47be3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:57.198962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b4a9-fb8e-46a8-b23e-7abc3bc47be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:57.200397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b4a9-fb8e-46a8-b23e-7abc3bc47be3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:57.217442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 392/784] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:57.224868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf83c40-87de-4dad-af5d-06ee729bf09f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:57.284500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2a81-db0f-4e21-88fe-e2c1664be911 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.285220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2a81-db0f-4e21-88fe-e2c1664be911 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.285739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2a81-db0f-4e21-88fe-e2c1664be911 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.289675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 393/785] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:57.294382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76308a-7e4e-4f1f-8fe5-1809a2a85f02 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.294893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76308a-7e4e-4f1f-8fe5-1809a2a85f02 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.295377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76308a-7e4e-4f1f-8fe5-1809a2a85f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.302624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:57.325563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-fb76308a-7e4e-4f1f-8fe5-1809a2a85f02 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:57.328972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fb76308a-7e4e-4f1f-8fe5-1809a2a85f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:57.422238 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:57.429644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf83c40-87de-4dad-af5d-06ee729bf09f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:57.448710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 394/786] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:00:57.468075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76308a-7e4e-4f1f-8fe5-1809a2a85f02 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:57.469201 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22ed31-1129-4fea-a9fe-05b470dde7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:57.470022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22ed31-1129-4fea-a9fe-05b470dde7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.470310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22ed31-1129-4fea-a9fe-05b470dde7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.470591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22ed31-1129-4fea-a9fe-05b470dde7c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.486913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22ed31-1129-4fea-a9fe-05b470dde7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:57.488279 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22ed31-1129-4fea-a9fe-05b470dde7c1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-2c22ed31-1129-4fea-a9fe-05b470dde7c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:57.510130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:57.511093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:57.511991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:57.511991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:57.511991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:57.511991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:57.514306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 393/787] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:57.521759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22ed31-1129-4fea-a9fe-05b470dde7c1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:57.592480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76308a-7e4e-4f1f-8fe5-1809a2a85f02 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:57.638072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76030ae-4fd4-49cc-a208-9d62c5d984e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:57.639364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76030ae-4fd4-49cc-a208-9d62c5d984e6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.639645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76030ae-4fd4-49cc-a208-9d62c5d984e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.640214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76030ae-4fd4-49cc-a208-9d62c5d984e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.645973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:57.656356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76030ae-4fd4-49cc-a208-9d62c5d984e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:57.661695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22ed31-1129-4fea-a9fe-05b470dde7c1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-d76030ae-4fd4-49cc-a208-9d62c5d984e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:57.667671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:57.668829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:00:57.669892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:57.672986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 395/788] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:00:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:00:57.679180 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76030ae-4fd4-49cc-a208-9d62c5d984e6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:57.703675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8312-907d-49e3-8ee5-2260339f738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:57.704530 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8312-907d-49e3-8ee5-2260339f738f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.704994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8312-907d-49e3-8ee5-2260339f738f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.705381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8312-907d-49e3-8ee5-2260339f738f None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.706471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b8312-907d-49e3-8ee5-2260339f738f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:57.706657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b8312-907d-49e3-8ee5-2260339f738f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:57.708226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b8312-907d-49e3-8ee5-2260339f738f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:57.721709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 394/789] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:57.732796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8312-907d-49e3-8ee5-2260339f738f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:57.754993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:57.859758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8312-907d-49e3-8ee5-2260339f738f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:57.867560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76030ae-4fd4-49cc-a208-9d62c5d984e6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:57.903228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f5235-b457-4f18-b324-6babf29b501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:57.903913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f5235-b457-4f18-b324-6babf29b501b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.904203 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f5235-b457-4f18-b324-6babf29b501b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.904485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f5235-b457-4f18-b324-6babf29b501b None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.905294 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f5235-b457-4f18-b324-6babf29b501b None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:57.905647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f5235-b457-4f18-b324-6babf29b501b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:57.906999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f5235-b457-4f18-b324-6babf29b501b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:57.917446 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 396/790] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:00:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:57.922787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f5235-b457-4f18-b324-6babf29b501b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:57.923888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00085b78-a28a-467f-99bd-6bfbeb2ce91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:57.924974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00085b78-a28a-467f-99bd-6bfbeb2ce91e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.925459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00085b78-a28a-467f-99bd-6bfbeb2ce91e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.925930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00085b78-a28a-467f-99bd-6bfbeb2ce91e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.941462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00085b78-a28a-467f-99bd-6bfbeb2ce91e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:57.943147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00085b78-a28a-467f-99bd-6bfbeb2ce91e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-00085b78-a28a-467f-99bd-6bfbeb2ce91e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:57.972580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:57.974159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:57.975117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:57.975117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:57.975117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:57.975117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:57.975117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:57.975117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:57.975117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:57.975117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:57.975117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:00:57.975117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:57.975117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 395/791] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:57.985652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00085b78-a28a-467f-99bd-6bfbeb2ce91e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:58.011508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:58.075002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f5235-b457-4f18-b324-6babf29b501b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:58.084979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:58.129990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4567d-2581-4511-ae06-1f629c11ed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:58.130611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4567d-2581-4511-ae06-1f629c11ed77 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.130958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4567d-2581-4511-ae06-1f629c11ed77 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.131241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4567d-2581-4511-ae06-1f629c11ed77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.142111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4567d-2581-4511-ae06-1f629c11ed77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:58.143582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4567d-2581-4511-ae06-1f629c11ed77 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-afa4567d-2581-4511-ae06-1f629c11ed77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:58.177558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:58.178500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:58.179409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:58.179409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:58.179409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:58.179409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:58.180133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 397/792] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:58.186139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4567d-2581-4511-ae06-1f629c11ed77 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:58.212600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00085b78-a28a-467f-99bd-6bfbeb2ce91e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:58.253745 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ddeb2-0ea9-40e5-b431-4314461fd005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:58.254961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ddeb2-0ea9-40e5-b431-4314461fd005 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.255250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ddeb2-0ea9-40e5-b431-4314461fd005 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.255532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ddeb2-0ea9-40e5-b431-4314461fd005 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.256484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ddeb2-0ea9-40e5-b431-4314461fd005 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:58.256831 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ddeb2-0ea9-40e5-b431-4314461fd005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:58.258385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ddeb2-0ea9-40e5-b431-4314461fd005 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:58.277658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 396/793] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jun 20 06:00:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:58.279242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d6a66-c34f-4538-8feb-188615089eb2 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.279661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d6a66-c34f-4538-8feb-188615089eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.280050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d6a66-c34f-4538-8feb-188615089eb2 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.281657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 397/794] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:58.286631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d6a66-c34f-4538-8feb-188615089eb2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:58.318069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4567d-2581-4511-ae06-1f629c11ed77 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:58.358407 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67e5dd-676e-4a1f-98a8-b404eeb414fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:58.359062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:58.359238 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67e5dd-676e-4a1f-98a8-b404eeb414fe None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.359601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67e5dd-676e-4a1f-98a8-b404eeb414fe None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.359947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67e5dd-676e-4a1f-98a8-b404eeb414fe None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.360781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67e5dd-676e-4a1f-98a8-b404eeb414fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:58.361168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67e5dd-676e-4a1f-98a8-b404eeb414fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:58.362671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67e5dd-676e-4a1f-98a8-b404eeb414fe None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:58.375107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 398/795] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:58.376533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2aaea2-6896-424e-9170-f01e17498462 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.376946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2aaea2-6896-424e-9170-f01e17498462 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.377324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2aaea2-6896-424e-9170-f01e17498462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.394097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-fd2aaea2-6896-424e-9170-f01e17498462 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:58.395607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fd2aaea2-6896-424e-9170-f01e17498462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:58.397544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d6a66-c34f-4538-8feb-188615089eb2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:58.412362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:58.438140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513eaf5b-d0bf-4710-bda7-9d12a99566fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:58.438890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513eaf5b-d0bf-4710-bda7-9d12a99566fb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.439179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513eaf5b-d0bf-4710-bda7-9d12a99566fb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.439459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513eaf5b-d0bf-4710-bda7-9d12a99566fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.450989 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513eaf5b-d0bf-4710-bda7-9d12a99566fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:58.452550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513eaf5b-d0bf-4710-bda7-9d12a99566fb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:58.469299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 399/796] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:00:58.470387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2aaea2-6896-424e-9170-f01e17498462 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-513eaf5b-d0bf-4710-bda7-9d12a99566fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:58.479177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:58.480098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:58.481319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:58.481319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:58.481319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:58.481319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:58.481319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 398/797] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:58.486536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513eaf5b-d0bf-4710-bda7-9d12a99566fb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:58.594123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2aaea2-6896-424e-9170-f01e17498462 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:58.614692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513eaf5b-d0bf-4710-bda7-9d12a99566fb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:58.634146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:58.648121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b9bdc-0ebb-4c01-afa0-bafd6fff3591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:58.649649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b9bdc-0ebb-4c01-afa0-bafd6fff3591 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.650109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b9bdc-0ebb-4c01-afa0-bafd6fff3591 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.650556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b9bdc-0ebb-4c01-afa0-bafd6fff3591 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.654136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0696-b6ac-4816-8362-3958d3554bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:58.654910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0696-b6ac-4816-8362-3958d3554bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.655275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0696-b6ac-4816-8362-3958d3554bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.655634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0696-b6ac-4816-8362-3958d3554bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.656443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e0696-b6ac-4816-8362-3958d3554bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:58.656850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e0696-b6ac-4816-8362-3958d3554bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:58.658325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e0696-b6ac-4816-8362-3958d3554bb0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:58.660259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b9bdc-0ebb-4c01-afa0-bafd6fff3591 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:58.662290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b9bdc-0ebb-4c01-afa0-bafd6fff3591 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:58.675607 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 399/798] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:00:58.677182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0696-b6ac-4816-8362-3958d3554bb0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-5a4b9bdc-0ebb-4c01-afa0-bafd6fff3591 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:58.679541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:58.680454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:58.681450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:58.681450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:58.681450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:58.681450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:58.681450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:58.681450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:58.681450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:58.681450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:58.681450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:00:58.681450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:58.688557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 400/799] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jun 20 06:00:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:58.689678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b9bdc-0ebb-4c01-afa0-bafd6fff3591 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:58.701830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:58.781712 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0696-b6ac-4816-8362-3958d3554bb0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:58.804288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b9bdc-0ebb-4c01-afa0-bafd6fff3591 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:58.816941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b7686-14f8-45e8-9d35-082d5e372f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:58.817834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b7686-14f8-45e8-9d35-082d5e372f67 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.818196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b7686-14f8-45e8-9d35-082d5e372f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.818576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b7686-14f8-45e8-9d35-082d5e372f67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.829247 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b7686-14f8-45e8-9d35-082d5e372f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e65b7686-14f8-45e8-9d35-082d5e372f67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:00:58.837725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:58.838877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:00:58.839916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:58.841252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 400/800] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:58.842173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b7686-14f8-45e8-9d35-082d5e372f67 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:58.846133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388b17-7a59-42f0-9c5b-f92f7237c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:58.847242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388b17-7a59-42f0-9c5b-f92f7237c830 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.847826 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388b17-7a59-42f0-9c5b-f92f7237c830 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.848341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388b17-7a59-42f0-9c5b-f92f7237c830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.856282 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388b17-7a59-42f0-9c5b-f92f7237c830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:58.858047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388b17-7a59-42f0-9c5b-f92f7237c830 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-76388b17-7a59-42f0-9c5b-f92f7237c830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:00:58.873503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:58.874409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:58.875311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:00:58.875311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:00:58.875311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:00:58.875311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:00:58.875311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:00:58.875311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:00:58.875311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:00:58.875311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:58.877797 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 401/801] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:58.878774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388b17-7a59-42f0-9c5b-f92f7237c830 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:58.893088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:58.978197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b7686-14f8-45e8-9d35-082d5e372f67 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:58.979908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:59.016433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18731d5f-9dad-49a5-a5bb-75d3b01d131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:59.017470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18731d5f-9dad-49a5-a5bb-75d3b01d131a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.017977 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18731d5f-9dad-49a5-a5bb-75d3b01d131a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.018486 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18731d5f-9dad-49a5-a5bb-75d3b01d131a None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.019534 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18731d5f-9dad-49a5-a5bb-75d3b01d131a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:59.020155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18731d5f-9dad-49a5-a5bb-75d3b01d131a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:59.021873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18731d5f-9dad-49a5-a5bb-75d3b01d131a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:59.027663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388b17-7a59-42f0-9c5b-f92f7237c830 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:59.041746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 401/802] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jun 20 06:00:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:59.043014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18731d5f-9dad-49a5-a5bb-75d3b01d131a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:59.076382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bab5a-2933-4003-9309-6c2c51795498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:59.077081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bab5a-2933-4003-9309-6c2c51795498 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.077368 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bab5a-2933-4003-9309-6c2c51795498 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.077849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bab5a-2933-4003-9309-6c2c51795498 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.078508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bab5a-2933-4003-9309-6c2c51795498 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:59.078722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bab5a-2933-4003-9309-6c2c51795498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:59.080093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bab5a-2933-4003-9309-6c2c51795498 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:59.093433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 402/803] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:59.093433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bab5a-2933-4003-9309-6c2c51795498 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:59.152425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:59.159445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18731d5f-9dad-49a5-a5bb-75d3b01d131a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:59.197437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0e16e-866a-43dc-b2e2-716d1bc53a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:59.198282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0e16e-866a-43dc-b2e2-716d1bc53a29 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.198647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0e16e-866a-43dc-b2e2-716d1bc53a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.198938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0e16e-866a-43dc-b2e2-716d1bc53a29 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.199733 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0e16e-866a-43dc-b2e2-716d1bc53a29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:59.200042 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0e16e-866a-43dc-b2e2-716d1bc53a29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:59.201507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0e16e-866a-43dc-b2e2-716d1bc53a29 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:59.204576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bab5a-2933-4003-9309-6c2c51795498 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:59.218223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 402/804] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:00:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:59.218223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c3ac8-adae-4c93-8720-559fafe3f5e8 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.218223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c3ac8-adae-4c93-8720-559fafe3f5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.218223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c3ac8-adae-4c93-8720-559fafe3f5e8 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.218223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 403/805] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:59.218223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c3ac8-adae-4c93-8720-559fafe3f5e8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:59.243686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:59.251788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe13d71-438d-42f0-8ea9-f16ad73568ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:59.253004 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe13d71-438d-42f0-8ea9-f16ad73568ba None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.253487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe13d71-438d-42f0-8ea9-f16ad73568ba None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.253763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe13d71-438d-42f0-8ea9-f16ad73568ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.266285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe13d71-438d-42f0-8ea9-f16ad73568ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:59.267781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe13d71-438d-42f0-8ea9-f16ad73568ba None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-dfe13d71-438d-42f0-8ea9-f16ad73568ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:59.286420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:59.287500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:59.288435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:59.288435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:59.288435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:59.288435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:59.288435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 403/806] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:59.288435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe13d71-438d-42f0-8ea9-f16ad73568ba None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:59.338107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c3ac8-adae-4c93-8720-559fafe3f5e8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:59.374480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de4eea-ec80-44f8-8af7-8411783e877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:59.375615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de4eea-ec80-44f8-8af7-8411783e877c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.375905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de4eea-ec80-44f8-8af7-8411783e877c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.376188 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de4eea-ec80-44f8-8af7-8411783e877c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.387189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de4eea-ec80-44f8-8af7-8411783e877c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:59.388664 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de4eea-ec80-44f8-8af7-8411783e877c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:59.400257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe13d71-438d-42f0-8ea9-f16ad73568ba None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-36de4eea-ec80-44f8-8af7-8411783e877c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:00:59.407803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:59.408736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:59.415147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:00:59.415147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:00:59.415147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:00:59.415147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:59.415147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 404/807] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:59.415147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5f1f-80a9-4bcb-a2e8-652dc56b5f4d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.415147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5f1f-80a9-4bcb-a2e8-652dc56b5f4d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.415147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5f1f-80a9-4bcb-a2e8-652dc56b5f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.428788 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-422f5f1f-80a9-4bcb-a2e8-652dc56b5f4d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:59.429978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-422f5f1f-80a9-4bcb-a2e8-652dc56b5f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:59.432286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:59.445665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd8db8-6989-4304-adf8-a022fb8a2f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:59.446599 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd8db8-6989-4304-adf8-a022fb8a2f07 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.446888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd8db8-6989-4304-adf8-a022fb8a2f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.447171 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd8db8-6989-4304-adf8-a022fb8a2f07 None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/0aadba0174824781b1866da7ba39956e/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.449179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd8db8-6989-4304-adf8-a022fb8a2f07 None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=0aadba0174824781b1866da7ba39956e, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:59.450640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd8db8-6989-4304-adf8-a022fb8a2f07 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:59.466897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 404/808] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:00:59 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/0aadba0174824781b1866da7ba39956e/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:00:59.467951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd8db8-6989-4304-adf8-a022fb8a2f07 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:59.519262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 405/809] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:00:59.519262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5f1f-80a9-4bcb-a2e8-652dc56b5f4d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:59.554514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:59.634445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5f1f-80a9-4bcb-a2e8-652dc56b5f4d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:59.641874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd8db8-6989-4304-adf8-a022fb8a2f07 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:59.674338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b1c9f-5c3a-40c4-95fe-5a86ba25bc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:59.675281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b1c9f-5c3a-40c4-95fe-5a86ba25bc3f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.675723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b1c9f-5c3a-40c4-95fe-5a86ba25bc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.676978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b1c9f-5c3a-40c4-95fe-5a86ba25bc3f None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.678146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b1c9f-5c3a-40c4-95fe-5a86ba25bc3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:59.678498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b1c9f-5c3a-40c4-95fe-5a86ba25bc3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:59.679843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b1c9f-5c3a-40c4-95fe-5a86ba25bc3f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:59.680955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb114cb-4be3-4ba3-94da-c5fbd0c036da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:59.681630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb114cb-4be3-4ba3-94da-c5fbd0c036da None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.681921 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb114cb-4be3-4ba3-94da-c5fbd0c036da None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.682207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb114cb-4be3-4ba3-94da-c5fbd0c036da None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.682939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb114cb-4be3-4ba3-94da-c5fbd0c036da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:00:59.683254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb114cb-4be3-4ba3-94da-c5fbd0c036da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:59.684644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb114cb-4be3-4ba3-94da-c5fbd0c036da None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:59.687531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:59.694814 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 406/810] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:59.695879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b1c9f-5c3a-40c4-95fe-5a86ba25bc3f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:59.703097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 405/811] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:00:59.704485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c753f-d3cf-4d26-a1d4-9c1328cc5829 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.704885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c753f-d3cf-4d26-a1d4-9c1328cc5829 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.705232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c753f-d3cf-4d26-a1d4-9c1328cc5829 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.706799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 406/812] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:59.708381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c753f-d3cf-4d26-a1d4-9c1328cc5829 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:59.815891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b1c9f-5c3a-40c4-95fe-5a86ba25bc3f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:59.819001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c753f-d3cf-4d26-a1d4-9c1328cc5829 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:59.820764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:59.851741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677469a-2cde-4f8d-9630-64eb56d579b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:59.852563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677469a-2cde-4f8d-9630-64eb56d579b5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.852882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677469a-2cde-4f8d-9630-64eb56d579b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.853166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677469a-2cde-4f8d-9630-64eb56d579b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.853826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677469a-2cde-4f8d-9630-64eb56d579b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:59.855235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677469a-2cde-4f8d-9630-64eb56d579b5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:59.859923 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47253-79ac-4cb5-9f06-90edeb8151f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:59.861015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47253-79ac-4cb5-9f06-90edeb8151f6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.861442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47253-79ac-4cb5-9f06-90edeb8151f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.861859 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47253-79ac-4cb5-9f06-90edeb8151f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4677469a-2cde-4f8d-9630-64eb56d579b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:59.868978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:59.870137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 06:00:59.871180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:00:59.874404 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47253-79ac-4cb5-9f06-90edeb8151f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:59.874941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 407/813] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Jun 20 06:00:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:59.875860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677469a-2cde-4f8d-9630-64eb56d579b5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:59.876423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47253-79ac-4cb5-9f06-90edeb8151f6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-0ee47253-79ac-4cb5-9f06-90edeb8151f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:00:59.893538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:00:59.894832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:00:59.896503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:00:59.896503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:00:59.896503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:00:59.896503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:00:59.896503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:00:59.896503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:00:59.896503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:00:59.896503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:00:59.896503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:00:59.896503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:00:59.898490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 407/814] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jun 20 06:00:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:00:59.899954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59708ff5-87c7-4064-aac7-90ea5b7e0d48 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.900237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59708ff5-87c7-4064-aac7-90ea5b7e0d48 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.900512 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59708ff5-87c7-4064-aac7-90ea5b7e0d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.919147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-59708ff5-87c7-4064-aac7-90ea5b7e0d48 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:59.920324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-59708ff5-87c7-4064-aac7-90ea5b7e0d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:59.948262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:59.994412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677469a-2cde-4f8d-9630-64eb56d579b5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:00.004965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 408/815] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:00.006828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59708ff5-87c7-4064-aac7-90ea5b7e0d48 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.031024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76b93e-d91c-4cda-8462-864249420618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:00.031822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b93e-d91c-4cda-8462-864249420618 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.032106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b93e-d91c-4cda-8462-864249420618 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.032383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b93e-d91c-4cda-8462-864249420618 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.040468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76b93e-d91c-4cda-8462-864249420618 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:00.041954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76b93e-d91c-4cda-8462-864249420618 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4a76b93e-d91c-4cda-8462-864249420618 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:00.056407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:00.057508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:00.058418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:00.058418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:00.058418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:00.058418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:00.058418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:00.058418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:00.058418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:00.058418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:00.061324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 408/816] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:00:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:00.063147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76b93e-d91c-4cda-8462-864249420618 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.112464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:00.123616 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59708ff5-87c7-4064-aac7-90ea5b7e0d48 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:00.161474 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c81f3-df17-40e4-877b-7391ee05a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:00.162476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c81f3-df17-40e4-877b-7391ee05a387 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.162763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c81f3-df17-40e4-877b-7391ee05a387 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.163044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c81f3-df17-40e4-877b-7391ee05a387 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.163760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c81f3-df17-40e4-877b-7391ee05a387 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:00.164072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c81f3-df17-40e4-877b-7391ee05a387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:00.165520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c81f3-df17-40e4-877b-7391ee05a387 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:00.170134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 409/817] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jun 20 06:01:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:00.170916 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c81f3-df17-40e4-877b-7391ee05a387 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.179075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76b93e-d91c-4cda-8462-864249420618 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:00.203095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:00.219339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b718e-f3ee-458c-99d2-c8941da4e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:00.220380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b718e-f3ee-458c-99d2-c8941da4e9fe None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.220705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b718e-f3ee-458c-99d2-c8941da4e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.220988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b718e-f3ee-458c-99d2-c8941da4e9fe None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.222170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b718e-f3ee-458c-99d2-c8941da4e9fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:00.222468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b718e-f3ee-458c-99d2-c8941da4e9fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:00.225096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b718e-f3ee-458c-99d2-c8941da4e9fe None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:00.247982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 409/818] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jun 20 06:01:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:00.247982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b718e-f3ee-458c-99d2-c8941da4e9fe None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.286906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c81f3-df17-40e4-877b-7391ee05a387 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:00.324497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b16c0-6e81-42aa-b6e4-c0b621e2ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:00.325320 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b16c0-6e81-42aa-b6e4-c0b621e2ad99 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.325607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b16c0-6e81-42aa-b6e4-c0b621e2ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.325892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b16c0-6e81-42aa-b6e4-c0b621e2ad99 None admin] PATH_INFO: `/v3/services/network` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.326550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b16c0-6e81-42aa-b6e4-c0b621e2ad99 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:00.327945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b16c0-6e81-42aa-b6e4-c0b621e2ad99 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-664b16c0-6e81-42aa-b6e4-c0b621e2ad99 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:00.340079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:00.341204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:00.342080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 410/819] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:00 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:00.343190 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b16c0-6e81-42aa-b6e4-c0b621e2ad99 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.359942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b718e-f3ee-458c-99d2-c8941da4e9fe None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:00.365749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:00.398921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a9888-98ad-43b2-afde-4e0bb7486754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:00.399909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a9888-98ad-43b2-afde-4e0bb7486754 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.400471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a9888-98ad-43b2-afde-4e0bb7486754 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.400933 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a9888-98ad-43b2-afde-4e0bb7486754 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.401864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a9888-98ad-43b2-afde-4e0bb7486754 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:00.402337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a9888-98ad-43b2-afde-4e0bb7486754 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:00.404114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a9888-98ad-43b2-afde-4e0bb7486754 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:00.417548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 410/820] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:00.418345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a9888-98ad-43b2-afde-4e0bb7486754 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.448882 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b16c0-6e81-42aa-b6e4-c0b621e2ad99 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:00.462875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:00.486278 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f57c4e-8a02-4dd8-89b8-3f74f3beccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:00.487186 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f57c4e-8a02-4dd8-89b8-3f74f3beccf5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.487637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f57c4e-8a02-4dd8-89b8-3f74f3beccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.488063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f57c4e-8a02-4dd8-89b8-3f74f3beccf5 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.489390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f57c4e-8a02-4dd8-89b8-3f74f3beccf5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:00.489868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f57c4e-8a02-4dd8-89b8-3f74f3beccf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:00.491405 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f57c4e-8a02-4dd8-89b8-3f74f3beccf5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:00.500894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 411/821] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jun 20 06:01:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:00.501929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f57c4e-8a02-4dd8-89b8-3f74f3beccf5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.526529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a9888-98ad-43b2-afde-4e0bb7486754 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:00.567159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cfb26-2031-4fde-b08b-23b09d2bf0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:00.567159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cfb26-2031-4fde-b08b-23b09d2bf0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.567159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cfb26-2031-4fde-b08b-23b09d2bf0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.567159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cfb26-2031-4fde-b08b-23b09d2bf0c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.594010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:00.614910 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f57c4e-8a02-4dd8-89b8-3f74f3beccf5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:00.650440 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cfb26-2031-4fde-b08b-23b09d2bf0c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:00.651906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cfb26-2031-4fde-b08b-23b09d2bf0c1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:00.653421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c06a0-9998-4e90-b39d-1ff1e144f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:00.654085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c06a0-9998-4e90-b39d-1ff1e144f3af None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.654371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c06a0-9998-4e90-b39d-1ff1e144f3af None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.654656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c06a0-9998-4e90-b39d-1ff1e144f3af None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.655365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c06a0-9998-4e90-b39d-1ff1e144f3af None admin] RBAC: Adding query filter params (name=network) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:00.655664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c06a0-9998-4e90-b39d-1ff1e144f3af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:00.657074 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c06a0-9998-4e90-b39d-1ff1e144f3af None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:00.662639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 412/822] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:01:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:00.663416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c06a0-9998-4e90-b39d-1ff1e144f3af None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.697999 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:00.765735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 411/823] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:00.766852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cfb26-2031-4fde-b08b-23b09d2bf0c1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.775722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c06a0-9998-4e90-b39d-1ff1e144f3af None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:00.812233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c186b-7fcf-4f2e-89b2-a6a039d6adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:00.813260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c186b-7fcf-4f2e-89b2-a6a039d6adfb None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.813547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c186b-7fcf-4f2e-89b2-a6a039d6adfb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.813827 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c186b-7fcf-4f2e-89b2-a6a039d6adfb None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/6c8e272684d542caaaecce191467edc6/roles/acb584c0cfb34695a7cd4ba39aabb279` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.831680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c186b-7fcf-4f2e-89b2-a6a039d6adfb None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=6c8e272684d542caaaecce191467edc6, role_id=acb584c0cfb34695a7cd4ba39aabb279)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:00.833659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c186b-7fcf-4f2e-89b2-a6a039d6adfb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:00.842367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:00.850610 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 413/824] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:01:00 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/6c8e272684d542caaaecce191467edc6/roles/acb584c0cfb34695a7cd4ba39aabb279 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:01:00.851436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c186b-7fcf-4f2e-89b2-a6a039d6adfb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.888483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cfb26-2031-4fde-b08b-23b09d2bf0c1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:00.930600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b48a-9332-44b6-92e3-b808a664abe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:00.931580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b48a-9332-44b6-92e3-b808a664abe6 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.932034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b48a-9332-44b6-92e3-b808a664abe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.932508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b48a-9332-44b6-92e3-b808a664abe6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.933544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078b48a-9332-44b6-92e3-b808a664abe6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:00.935195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078b48a-9332-44b6-92e3-b808a664abe6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:00.946387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:00.967604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 412/825] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jun 20 06:01:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:00.968846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b48a-9332-44b6-92e3-b808a664abe6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.978775 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c186b-7fcf-4f2e-89b2-a6a039d6adfb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:01.031712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775456fd-0304-443f-b04a-e74ddf922092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:01.033042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775456fd-0304-443f-b04a-e74ddf922092 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:01.033477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775456fd-0304-443f-b04a-e74ddf922092 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:01.033902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775456fd-0304-443f-b04a-e74ddf922092 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:01.035194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775456fd-0304-443f-b04a-e74ddf922092 None admin] RBAC: Adding query filter params (type=network) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:01.035749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775456fd-0304-443f-b04a-e74ddf922092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:01.037469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775456fd-0304-443f-b04a-e74ddf922092 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:01.043909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 414/826] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:01:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:01.054630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775456fd-0304-443f-b04a-e74ddf922092 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:01.113196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b48a-9332-44b6-92e3-b808a664abe6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:01.122993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:01.160424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab46bb-80d0-47ce-93f8-966c16053a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:01.162497 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab46bb-80d0-47ce-93f8-966c16053a33 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:01.162985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab46bb-80d0-47ce-93f8-966c16053a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:01.163573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab46bb-80d0-47ce-93f8-966c16053a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:01.173277 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775456fd-0304-443f-b04a-e74ddf922092 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:01.181866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab46bb-80d0-47ce-93f8-966c16053a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:01.184284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab46bb-80d0-47ce-93f8-966c16053a33 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-5dab46bb-80d0-47ce-93f8-966c16053a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:01.225642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:01.226622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:01.227541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:01.227541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:01.227541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:01.227541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:01.229847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 413/827] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:01.235031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab46bb-80d0-47ce-93f8-966c16053a33 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:01.238032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc578b-23eb-4179-ab11-157b8dc00423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:01.239743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc578b-23eb-4179-ab11-157b8dc00423 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:01.240207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc578b-23eb-4179-ab11-157b8dc00423 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:01.240679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc578b-23eb-4179-ab11-157b8dc00423 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:01.241624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc578b-23eb-4179-ab11-157b8dc00423 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:01.243208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc578b-23eb-4179-ab11-157b8dc00423 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:01.268991 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 415/828] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jun 20 06:01:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:01.307849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:01.373058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab46bb-80d0-47ce-93f8-966c16053a33 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:01.422877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea5622-5f8f-498a-b1be-f73038ddd0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:01.423847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea5622-5f8f-498a-b1be-f73038ddd0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:01.424344 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea5622-5f8f-498a-b1be-f73038ddd0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:01.424845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea5622-5f8f-498a-b1be-f73038ddd0b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:01.425835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea5622-5f8f-498a-b1be-f73038ddd0b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:01.427196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea5622-5f8f-498a-b1be-f73038ddd0b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:01.428919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea5622-5f8f-498a-b1be-f73038ddd0b0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:01.444715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 414/829] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:01.451762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc578b-23eb-4179-ab11-157b8dc00423 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:01.569718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc578b-23eb-4179-ab11-157b8dc00423 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:01.586966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:01.614963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc950a40-4263-4411-a901-aaac7e460377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:01.615676 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc950a40-4263-4411-a901-aaac7e460377 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:01.615963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc950a40-4263-4411-a901-aaac7e460377 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:01.616242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc950a40-4263-4411-a901-aaac7e460377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:01.625119 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc950a40-4263-4411-a901-aaac7e460377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:01.626702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc950a40-4263-4411-a901-aaac7e460377 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:01.635274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9a15-1c17-4060-83eb-e6cce74a75bc None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:01.635570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9a15-1c17-4060-83eb-e6cce74a75bc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:01.635860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9a15-1c17-4060-83eb-e6cce74a75bc None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:01.637521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 415/830] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:01.642489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429a778-50c8-4538-ae67-4e337c7eafd0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:01.642785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429a778-50c8-4538-ae67-4e337c7eafd0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:01.643068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429a778-50c8-4538-ae67-4e337c7eafd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-bc950a40-4263-4411-a901-aaac7e460377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:01.644255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:01.646497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:01.647422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:01.647422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:01.647422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:01.647422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:01.647422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:01.647422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:01.647422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:01.647422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:01.650709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 416/831] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:01.651908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc950a40-4263-4411-a901-aaac7e460377 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:01.664513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8429a778-50c8-4538-ae67-4e337c7eafd0 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:01.665778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8429a778-50c8-4538-ae67-4e337c7eafd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:01.760800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 416/832] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:01.778548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc950a40-4263-4411-a901-aaac7e460377 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:01.792481 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429a778-50c8-4538-ae67-4e337c7eafd0 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:01.835290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5b216-53cb-4a6f-9fbe-65f603693e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:01.836651 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5b216-53cb-4a6f-9fbe-65f603693e98 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:01.837342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:01.837817 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5b216-53cb-4a6f-9fbe-65f603693e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:01.839475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5b216-53cb-4a6f-9fbe-65f603693e98 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:01.840676 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5b216-53cb-4a6f-9fbe-65f603693e98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:01.841215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5b216-53cb-4a6f-9fbe-65f603693e98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:01.842901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5b216-53cb-4a6f-9fbe-65f603693e98 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:01.857889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 417/833] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:01.865760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5b216-53cb-4a6f-9fbe-65f603693e98 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:01.905291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:01.983231 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5b216-53cb-4a6f-9fbe-65f603693e98 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:02.029294 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c723b-f6c9-4d3d-b06b-97fffc45b202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:02.030449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c723b-f6c9-4d3d-b06b-97fffc45b202 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:02.030891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c723b-f6c9-4d3d-b06b-97fffc45b202 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:02.031338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c723b-f6c9-4d3d-b06b-97fffc45b202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:02.032333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c723b-f6c9-4d3d-b06b-97fffc45b202 None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=3748d8369d20429eb2376ce02d42eee0) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:02.033263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c723b-f6c9-4d3d-b06b-97fffc45b202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:02.035932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c723b-f6c9-4d3d-b06b-97fffc45b202 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:02.044483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 418/834] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:01 2022] GET /identity/v3/role_assignments?user.id=3748d8369d20429eb2376ce02d42eee0&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=efc16976111d431c9173186cbd0e6c24 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:02.052016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429a778-50c8-4538-ae67-4e337c7eafd0 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:02.093354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320669c-cb92-4e5f-95d1-f99ee057d13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:02.095132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320669c-cb92-4e5f-95d1-f99ee057d13e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:02.095874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320669c-cb92-4e5f-95d1-f99ee057d13e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:02.096599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320669c-cb92-4e5f-95d1-f99ee057d13e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:02.110041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320669c-cb92-4e5f-95d1-f99ee057d13e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f320669c-cb92-4e5f-95d1-f99ee057d13e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:02.119086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:02.120101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:02.121010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:02.123858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 417/835] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:02.130044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c723b-f6c9-4d3d-b06b-97fffc45b202 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:02.241064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:02.245270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c723b-f6c9-4d3d-b06b-97fffc45b202 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:02.283327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd7b3-6fb4-4f49-ad38-5f6566f52b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:02.284069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd7b3-6fb4-4f49-ad38-5f6566f52b07 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:02.284734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd7b3-6fb4-4f49-ad38-5f6566f52b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:02.285144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd7b3-6fb4-4f49-ad38-5f6566f52b07 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:02.286733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbd7b3-6fb4-4f49-ad38-5f6566f52b07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:02.287168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbd7b3-6fb4-4f49-ad38-5f6566f52b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:02.288688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbd7b3-6fb4-4f49-ad38-5f6566f52b07 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:02.297738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 419/836] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:02.303763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320669c-cb92-4e5f-95d1-f99ee057d13e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:02.401330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:02.407983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320669c-cb92-4e5f-95d1-f99ee057d13e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:02.444079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93968f09-a6c0-4222-b947-8de9761766e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:02.445121 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93968f09-a6c0-4222-b947-8de9761766e7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:02.445514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93968f09-a6c0-4222-b947-8de9761766e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:02.445917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93968f09-a6c0-4222-b947-8de9761766e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:02.458720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93968f09-a6c0-4222-b947-8de9761766e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:02.460357 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93968f09-a6c0-4222-b947-8de9761766e7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-93968f09-a6c0-4222-b947-8de9761766e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:02.478947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:02.480089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:02.481226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:02.481226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:02.481226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:02.481226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:02.482742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 418/837] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:02.489345 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd7b3-6fb4-4f49-ad38-5f6566f52b07 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:02.596433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd7b3-6fb4-4f49-ad38-5f6566f52b07 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:02.633284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0eb7e2-d97a-472c-bc7f-bc7f91cb930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:02.633959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eb7e2-d97a-472c-bc7f-bc7f91cb930c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:02.634286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eb7e2-d97a-472c-bc7f-bc7f91cb930c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:02.634538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eb7e2-d97a-472c-bc7f-bc7f91cb930c None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:02.635269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0eb7e2-d97a-472c-bc7f-bc7f91cb930c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:02.635581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0eb7e2-d97a-472c-bc7f-bc7f91cb930c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:02.636999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0eb7e2-d97a-472c-bc7f-bc7f91cb930c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:02.654704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 420/838] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:02.656064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93968f09-a6c0-4222-b947-8de9761766e7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:02.760031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93968f09-a6c0-4222-b947-8de9761766e7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:02.795126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e4de8-cc74-45bc-a9f1-9202bb370e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:02.796305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e4de8-cc74-45bc-a9f1-9202bb370e0d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:02.796832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e4de8-cc74-45bc-a9f1-9202bb370e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:02.797314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e4de8-cc74-45bc-a9f1-9202bb370e0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:02.805661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e4de8-cc74-45bc-a9f1-9202bb370e0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:02.807424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e4de8-cc74-45bc-a9f1-9202bb370e0d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-c90e4de8-cc74-45bc-a9f1-9202bb370e0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:02.822971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:02.823979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:02.824981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:02.824981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:02.824981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:02.824981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:02.824981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:02.824981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:02.824981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:02.824981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:02.824981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 06:01:02.824981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:02.827632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 419/839] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:02.833822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0eb7e2-d97a-472c-bc7f-bc7f91cb930c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:02.856893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:02.944654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0eb7e2-d97a-472c-bc7f-bc7f91cb930c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:03.097598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89da6c-8ad7-44c2-bc5c-1482e02f1f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:03.098729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89da6c-8ad7-44c2-bc5c-1482e02f1f15 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.099191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89da6c-8ad7-44c2-bc5c-1482e02f1f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.099634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89da6c-8ad7-44c2-bc5c-1482e02f1f15 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.101007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89da6c-8ad7-44c2-bc5c-1482e02f1f15 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:03.101467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89da6c-8ad7-44c2-bc5c-1482e02f1f15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:03.103077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89da6c-8ad7-44c2-bc5c-1482e02f1f15 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:03.126611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 421/840] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jun 20 06:01:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:03.128215 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e4de8-cc74-45bc-a9f1-9202bb370e0d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:03.138660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:03.141761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b50cd0-447c-4733-8014-cbb78feef3b7 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.142057 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b50cd0-447c-4733-8014-cbb78feef3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.142334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b50cd0-447c-4733-8014-cbb78feef3b7 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.143821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 422/841] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:03.149382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200bdaa-19ff-40aa-908b-11e1faa22d38 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.149668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200bdaa-19ff-40aa-908b-11e1faa22d38 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.149943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200bdaa-19ff-40aa-908b-11e1faa22d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.167701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5200bdaa-19ff-40aa-908b-11e1faa22d38 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:03.168907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5200bdaa-19ff-40aa-908b-11e1faa22d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:03.248335 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e4de8-cc74-45bc-a9f1-9202bb370e0d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:03.252934 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 423/842] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:03.272110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200bdaa-19ff-40aa-908b-11e1faa22d38 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:03.288960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:03.292605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f7d72-745d-49d8-9f16-5f1bcc073557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:03.293359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f7d72-745d-49d8-9f16-5f1bcc073557 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.293648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f7d72-745d-49d8-9f16-5f1bcc073557 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.293931 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f7d72-745d-49d8-9f16-5f1bcc073557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.386063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f7d72-745d-49d8-9f16-5f1bcc073557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:03.386981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200bdaa-19ff-40aa-908b-11e1faa22d38 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:03.387477 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f7d72-745d-49d8-9f16-5f1bcc073557 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:03.396935 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:03.425631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb27e89-b4dc-46a1-ba71-fe9b6ca6e1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:03.426973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27e89-b4dc-46a1-ba71-fe9b6ca6e1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.427260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27e89-b4dc-46a1-ba71-fe9b6ca6e1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.427533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27e89-b4dc-46a1-ba71-fe9b6ca6e1c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.438917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb27e89-b4dc-46a1-ba71-fe9b6ca6e1c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-afb27e89-b4dc-46a1-ba71-fe9b6ca6e1c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:03.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:03.447721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:03.449471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 424/843] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:01:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:03.450174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25089c-97ae-47cd-87f3-00859e6255f5 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.450174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25089c-97ae-47cd-87f3-00859e6255f5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.450174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25089c-97ae-47cd-87f3-00859e6255f5 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.451547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 425/844] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:03.453542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25089c-97ae-47cd-87f3-00859e6255f5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:03.504885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 420/845] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:03.509563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3fa5-1973-44b2-85b0-76379ca08ebb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.509563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3fa5-1973-44b2-85b0-76379ca08ebb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.509563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3fa5-1973-44b2-85b0-76379ca08ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.525331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-972e3fa5-1973-44b2-85b0-76379ca08ebb None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:03.526542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-972e3fa5-1973-44b2-85b0-76379ca08ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:03.531854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:03.569837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25089c-97ae-47cd-87f3-00859e6255f5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:03.604738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 421/846] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:03.604738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e3fa5-1973-44b2-85b0-76379ca08ebb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:03.615988 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ff08-25b2-4626-97ec-b8df1c4e0be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:03.616694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ff08-25b2-4626-97ec-b8df1c4e0be5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.616987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ff08-25b2-4626-97ec-b8df1c4e0be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.617271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ff08-25b2-4626-97ec-b8df1c4e0be5 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.628051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4ff08-25b2-4626-97ec-b8df1c4e0be5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:03.628153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4ff08-25b2-4626-97ec-b8df1c4e0be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:03.629651 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4ff08-25b2-4626-97ec-b8df1c4e0be5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:03.642579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 426/847] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:01:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:03.642579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ff08-25b2-4626-97ec-b8df1c4e0be5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:03.649314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:03.719793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e3fa5-1973-44b2-85b0-76379ca08ebb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:03.741195 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ff08-25b2-4626-97ec-b8df1c4e0be5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:03.757920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd76b36-1e7f-407a-9c99-03e8434b54a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:03.758727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd76b36-1e7f-407a-9c99-03e8434b54a5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.759017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd76b36-1e7f-407a-9c99-03e8434b54a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.759296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd76b36-1e7f-407a-9c99-03e8434b54a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.769453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd76b36-1e7f-407a-9c99-03e8434b54a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:03.770974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd76b36-1e7f-407a-9c99-03e8434b54a5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:03.771631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:03.778513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981cdf4-3d74-4f4e-8c86-7b46b1ff647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:03.779339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981cdf4-3d74-4f4e-8c86-7b46b1ff647a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.779603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981cdf4-3d74-4f4e-8c86-7b46b1ff647a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.779889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981cdf4-3d74-4f4e-8c86-7b46b1ff647a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.780544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981cdf4-3d74-4f4e-8c86-7b46b1ff647a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:03.781947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981cdf4-3d74-4f4e-8c86-7b46b1ff647a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-0dd76b36-1e7f-407a-9c99-03e8434b54a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:03.790089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:03.791028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:03.798014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:03.798014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:03.798014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:03.798014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:03.798014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 422/848] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:03.798014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd76b36-1e7f-407a-9c99-03e8434b54a5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-7981cdf4-3d74-4f4e-8c86-7b46b1ff647a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:03.798373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:03.803088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:03.804110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 427/849] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:01:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:03.805149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981cdf4-3d74-4f4e-8c86-7b46b1ff647a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:03.894323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:03.911777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd76b36-1e7f-407a-9c99-03e8434b54a5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:03.912165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981cdf4-3d74-4f4e-8c86-7b46b1ff647a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:03.948172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a1d40-1a3b-4cc7-aa47-347b8b8ba3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:03.949001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1d40-1a3b-4cc7-aa47-347b8b8ba3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.949361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1d40-1a3b-4cc7-aa47-347b8b8ba3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.949743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1d40-1a3b-4cc7-aa47-347b8b8ba3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.950474 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a1d40-1a3b-4cc7-aa47-347b8b8ba3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:03.950787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a1d40-1a3b-4cc7-aa47-347b8b8ba3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:03.952170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a1d40-1a3b-4cc7-aa47-347b8b8ba3e3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:03.956060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49033c1b-79f6-4fa2-8469-91b5ffb280cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:03.956899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49033c1b-79f6-4fa2-8469-91b5ffb280cf None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.957224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49033c1b-79f6-4fa2-8469-91b5ffb280cf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.957502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49033c1b-79f6-4fa2-8469-91b5ffb280cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.964683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 428/850] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:03.965521 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a1d40-1a3b-4cc7-aa47-347b8b8ba3e3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:03.973156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49033c1b-79f6-4fa2-8469-91b5ffb280cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:03.974728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49033c1b-79f6-4fa2-8469-91b5ffb280cf None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-49033c1b-79f6-4fa2-8469-91b5ffb280cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:03.993635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:03.994684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:03.995612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:03.995612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:03.995612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:03.995612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:03.995612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 423/851] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:03.995612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49033c1b-79f6-4fa2-8469-91b5ffb280cf None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.030148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:04.078145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a1d40-1a3b-4cc7-aa47-347b8b8ba3e3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.106678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49033c1b-79f6-4fa2-8469-91b5ffb280cf None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.111827 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9e0c3-2f6a-4212-a7d3-2376f64c4f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.112496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9e0c3-2f6a-4212-a7d3-2376f64c4f54 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.112815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9e0c3-2f6a-4212-a7d3-2376f64c4f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.113102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9e0c3-2f6a-4212-a7d3-2376f64c4f54 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.114340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9e0c3-2f6a-4212-a7d3-2376f64c4f54 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:04.114662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9e0c3-2f6a-4212-a7d3-2376f64c4f54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.116043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9e0c3-2f6a-4212-a7d3-2376f64c4f54 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.120738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 429/852] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:01:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:04.121358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9e0c3-2f6a-4212-a7d3-2376f64c4f54 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.150035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb8aa4-6674-4fe9-bb16-4a3696bebf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.151481 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb8aa4-6674-4fe9-bb16-4a3696bebf34 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.151911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb8aa4-6674-4fe9-bb16-4a3696bebf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.152458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb8aa4-6674-4fe9-bb16-4a3696bebf34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.159949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb8aa4-6674-4fe9-bb16-4a3696bebf34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.161609 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb8aa4-6674-4fe9-bb16-4a3696bebf34 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.164636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-bafb8aa4-6674-4fe9-bb16-4a3696bebf34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:04.178310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:04.179235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:04.180151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:04.180151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:04.180151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:04.180151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:04.180151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:04.180151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:04.180151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:04.180151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:04.180151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 424/853] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:04.181268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb8aa4-6674-4fe9-bb16-4a3696bebf34 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.230216 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9e0c3-2f6a-4212-a7d3-2376f64c4f54 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.249717 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:04.268305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d98ac4-a314-437b-a73b-f24e92945c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.269007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d98ac4-a314-437b-a73b-f24e92945c03 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.269294 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d98ac4-a314-437b-a73b-f24e92945c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.269712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d98ac4-a314-437b-a73b-f24e92945c03 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.270462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d98ac4-a314-437b-a73b-f24e92945c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:04.270774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d98ac4-a314-437b-a73b-f24e92945c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.272154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d98ac4-a314-437b-a73b-f24e92945c03 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.284880 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 430/854] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:04.286370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d98ac4-a314-437b-a73b-f24e92945c03 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.292437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb8aa4-6674-4fe9-bb16-4a3696bebf34 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.326161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19c59b-f821-4d59-a0cc-7d18f57c4533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.326883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19c59b-f821-4d59-a0cc-7d18f57c4533 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.327173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19c59b-f821-4d59-a0cc-7d18f57c4533 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.327452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19c59b-f821-4d59-a0cc-7d18f57c4533 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.328166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19c59b-f821-4d59-a0cc-7d18f57c4533 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:04.328484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19c59b-f821-4d59-a0cc-7d18f57c4533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.329890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19c59b-f821-4d59-a0cc-7d18f57c4533 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.334351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 425/855] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:04.335158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19c59b-f821-4d59-a0cc-7d18f57c4533 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.407865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d98ac4-a314-437b-a73b-f24e92945c03 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.410798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:04.446160 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cb1c4-c7a9-4d1a-a28b-6adb8f8867ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.446845 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cb1c4-c7a9-4d1a-a28b-6adb8f8867ba None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.447135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cb1c4-c7a9-4d1a-a28b-6adb8f8867ba None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.447444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cb1c4-c7a9-4d1a-a28b-6adb8f8867ba None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.448229 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cb1c4-c7a9-4d1a-a28b-6adb8f8867ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:04.448549 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cb1c4-c7a9-4d1a-a28b-6adb8f8867ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.450064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cb1c4-c7a9-4d1a-a28b-6adb8f8867ba None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.457202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19c59b-f821-4d59-a0cc-7d18f57c4533 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.464255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 431/856] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:04.465661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0e0f-0457-4342-a302-6e3695f206a2 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.465954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0e0f-0457-4342-a302-6e3695f206a2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.466237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0e0f-0457-4342-a302-6e3695f206a2 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.470087 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 432/857] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:04.470087 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a0e0f-0457-4342-a302-6e3695f206a2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.505366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe483ed-2c15-4ecd-9c81-00e90e45e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.506474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe483ed-2c15-4ecd-9c81-00e90e45e966 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.506761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe483ed-2c15-4ecd-9c81-00e90e45e966 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.507038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe483ed-2c15-4ecd-9c81-00e90e45e966 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.514929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe483ed-2c15-4ecd-9c81-00e90e45e966 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.516379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe483ed-2c15-4ecd-9c81-00e90e45e966 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.521657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-0fe483ed-2c15-4ecd-9c81-00e90e45e966 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:04.531845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:04.532834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:04.533798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:04.533798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:04.533798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:04.533798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:04.533798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:04.533798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:04.533798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:04.533798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:04.533798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:01:04.533798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:04.533798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 426/858] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:04.534655 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec4483-ef79-4181-93ed-a4c6cdce4876 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.535911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec4483-ef79-4181-93ed-a4c6cdce4876 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.535911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec4483-ef79-4181-93ed-a4c6cdce4876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.553547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5fec4483-ef79-4181-93ed-a4c6cdce4876 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:04.554695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5fec4483-ef79-4181-93ed-a4c6cdce4876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:04.595642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a0e0f-0457-4342-a302-6e3695f206a2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.630142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 427/859] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:04.631491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec4483-ef79-4181-93ed-a4c6cdce4876 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.646048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6c11b-7260-4e89-b331-14ea748920aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.646841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6c11b-7260-4e89-b331-14ea748920aa None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.647196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6c11b-7260-4e89-b331-14ea748920aa None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.647543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6c11b-7260-4e89-b331-14ea748920aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.648741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6c11b-7260-4e89-b331-14ea748920aa None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=0aadba0174824781b1866da7ba39956e) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:04.649553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6c11b-7260-4e89-b331-14ea748920aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.651354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6c11b-7260-4e89-b331-14ea748920aa None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.659144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 433/860] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/role_assignments?user.id=0aadba0174824781b1866da7ba39956e&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=efc16976111d431c9173186cbd0e6c24 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:04.660120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6c11b-7260-4e89-b331-14ea748920aa None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.713379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:04.781321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec4483-ef79-4181-93ed-a4c6cdce4876 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.791370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6c11b-7260-4e89-b331-14ea748920aa None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.793108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:04.822118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25adb16-1483-4e63-9e8d-c29e3096c319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.823428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25adb16-1483-4e63-9e8d-c29e3096c319 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.823897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25adb16-1483-4e63-9e8d-c29e3096c319 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.824353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25adb16-1483-4e63-9e8d-c29e3096c319 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.825418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25adb16-1483-4e63-9e8d-c29e3096c319 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:04.825912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25adb16-1483-4e63-9e8d-c29e3096c319 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.827537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25adb16-1483-4e63-9e8d-c29e3096c319 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.836962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d636-ba32-4e97-8774-e1caf163db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.837784 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d636-ba32-4e97-8774-e1caf163db9c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.838069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d636-ba32-4e97-8774-e1caf163db9c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.838346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d636-ba32-4e97-8774-e1caf163db9c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.839002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3d636-ba32-4e97-8774-e1caf163db9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.840394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3d636-ba32-4e97-8774-e1caf163db9c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.850255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 428/861] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:04.855847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25adb16-1483-4e63-9e8d-c29e3096c319 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3bb3d636-ba32-4e97-8774-e1caf163db9c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:04.855980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:04.857020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 06:01:04.857892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:04.862715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 434/862] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:04.864118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d636-ba32-4e97-8774-e1caf163db9c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.979211 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25adb16-1483-4e63-9e8d-c29e3096c319 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.994131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:05.008683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d636-ba32-4e97-8774-e1caf163db9c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:05.018652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffc86-92a3-48bf-bce2-2204bbb4d443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:05.019313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffc86-92a3-48bf-bce2-2204bbb4d443 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:05.019633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffc86-92a3-48bf-bce2-2204bbb4d443 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:05.019948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffc86-92a3-48bf-bce2-2204bbb4d443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:05.049956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41d797-84e7-43ef-b33d-3dd88a878452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:05.050699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41d797-84e7-43ef-b33d-3dd88a878452 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:05.051055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41d797-84e7-43ef-b33d-3dd88a878452 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:05.051343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41d797-84e7-43ef-b33d-3dd88a878452 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:05.052208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41d797-84e7-43ef-b33d-3dd88a878452 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:05.052643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41d797-84e7-43ef-b33d-3dd88a878452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:05.054111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41d797-84e7-43ef-b33d-3dd88a878452 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:05.063982 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 435/863] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:05.064977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41d797-84e7-43ef-b33d-3dd88a878452 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:05.101970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:05.102516 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ffc86-92a3-48bf-bce2-2204bbb4d443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:05.105142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ffc86-92a3-48bf-bce2-2204bbb4d443 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:05.186181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41d797-84e7-43ef-b33d-3dd88a878452 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:05.221104 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4154-2720-407f-803f-a83fc1f87fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:05.221974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4154-2720-407f-803f-a83fc1f87fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:05.222267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4154-2720-407f-803f-a83fc1f87fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:05.222547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4154-2720-407f-803f-a83fc1f87fc9 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:05.223956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee4154-2720-407f-803f-a83fc1f87fc9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:05.224330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee4154-2720-407f-803f-a83fc1f87fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:05.225780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee4154-2720-407f-803f-a83fc1f87fc9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:05.241581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 436/864] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jun 20 06:01:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:05.242068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 429/865] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:05.242917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4154-2720-407f-803f-a83fc1f87fc9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:05.351123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:05.359355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4154-2720-407f-803f-a83fc1f87fc9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:05.397047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132a616-69d0-47da-9dda-8ca596c733b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:05.398183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a616-69d0-47da-9dda-8ca596c733b9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:05.398465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a616-69d0-47da-9dda-8ca596c733b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:05.398739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a616-69d0-47da-9dda-8ca596c733b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:05.411346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132a616-69d0-47da-9dda-8ca596c733b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:05.412866 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132a616-69d0-47da-9dda-8ca596c733b9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f132a616-69d0-47da-9dda-8ca596c733b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:05.431520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:05.432465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:05.433538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:05.433538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:05.433538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:05.433538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:05.433538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 437/866] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:05.438239 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffc86-92a3-48bf-bce2-2204bbb4d443 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:05.453614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:05.545976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffc86-92a3-48bf-bce2-2204bbb4d443 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:05.583431 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9bdb6-8ea5-4634-8944-cf8172077b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:05.584094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9bdb6-8ea5-4634-8944-cf8172077b2d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:05.584375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9bdb6-8ea5-4634-8944-cf8172077b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:05.584676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9bdb6-8ea5-4634-8944-cf8172077b2d None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:05.585470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9bdb6-8ea5-4634-8944-cf8172077b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:05.585773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9bdb6-8ea5-4634-8944-cf8172077b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:05.587195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9bdb6-8ea5-4634-8944-cf8172077b2d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:05.599121 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 430/867] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:05.604455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132a616-69d0-47da-9dda-8ca596c733b9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:05.716888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132a616-69d0-47da-9dda-8ca596c733b9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:05.757050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aae8f2-f3b0-436c-bf4e-42bac904941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:05.758239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae8f2-f3b0-436c-bf4e-42bac904941a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:05.758731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae8f2-f3b0-436c-bf4e-42bac904941a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:05.759213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae8f2-f3b0-436c-bf4e-42bac904941a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:05.766386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aae8f2-f3b0-436c-bf4e-42bac904941a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:05.768066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aae8f2-f3b0-436c-bf4e-42bac904941a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-18aae8f2-f3b0-436c-bf4e-42bac904941a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:05.783107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:05.784014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:05.785745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:05.785745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:05.785745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:05.785745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:05.785745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:05.785745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:05.785745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:05.785745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:05.788198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 438/868] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:05.793674 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9bdb6-8ea5-4634-8944-cf8172077b2d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:05.867110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:05.899616 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9bdb6-8ea5-4634-8944-cf8172077b2d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:05.935677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d34a-967f-4231-893c-73b0b957fb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:05.936341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d34a-967f-4231-893c-73b0b957fb63 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:05.936637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d34a-967f-4231-893c-73b0b957fb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:05.936931 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d34a-967f-4231-893c-73b0b957fb63 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:05.937719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524d34a-967f-4231-893c-73b0b957fb63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:05.938026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524d34a-967f-4231-893c-73b0b957fb63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:05.939440 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524d34a-967f-4231-893c-73b0b957fb63 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:05.952878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 431/869] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:05.958997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aae8f2-f3b0-436c-bf4e-42bac904941a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:05.968001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:06.072242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aae8f2-f3b0-436c-bf4e-42bac904941a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:06.107783 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e43149-12a8-4de2-8d5b-e08ad952347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:06.108450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43149-12a8-4de2-8d5b-e08ad952347a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:06.108766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43149-12a8-4de2-8d5b-e08ad952347a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:06.109050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43149-12a8-4de2-8d5b-e08ad952347a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:06.109895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e43149-12a8-4de2-8d5b-e08ad952347a None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=6c8e272684d542caaaecce191467edc6) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:06.110216 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e43149-12a8-4de2-8d5b-e08ad952347a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:06.111660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e43149-12a8-4de2-8d5b-e08ad952347a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:06.118302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 439/870] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:05 2022] GET /identity/v3/role_assignments?user.id=6c8e272684d542caaaecce191467edc6&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:06.433195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881714c-5474-4040-8bc2-a1d9035eddce None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:06.433731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881714c-5474-4040-8bc2-a1d9035eddce None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:06.433731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881714c-5474-4040-8bc2-a1d9035eddce None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:06.435399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 432/871] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:06.441301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd7c0d-3f27-4cdd-946b-d77985f7a619 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:06.442222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd7c0d-3f27-4cdd-946b-d77985f7a619 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:06.442452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd7c0d-3f27-4cdd-946b-d77985f7a619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:06.459411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-eafd7c0d-3f27-4cdd-946b-d77985f7a619 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:06.460599 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-eafd7c0d-3f27-4cdd-946b-d77985f7a619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:06.530317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:06.538056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 440/872] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:06.561065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881714c-5474-4040-8bc2-a1d9035eddce None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:06.671243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881714c-5474-4040-8bc2-a1d9035eddce None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:06.704412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:06.710760 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9260095-3a6f-41f2-958b-2478f8235f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:06.711705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9260095-3a6f-41f2-958b-2478f8235f49 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:06.712170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9260095-3a6f-41f2-958b-2478f8235f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:06.712649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9260095-3a6f-41f2-958b-2478f8235f49 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:06.713577 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9260095-3a6f-41f2-958b-2478f8235f49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:06.715138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9260095-3a6f-41f2-958b-2478f8235f49 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:06.732704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 433/873] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 06:01:06 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:06.828341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fc3f5-a905-4755-b6a9-5c6fe1dd7c6d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:06.828661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fc3f5-a905-4755-b6a9-5c6fe1dd7c6d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:06.828945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fc3f5-a905-4755-b6a9-5c6fe1dd7c6d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:06.830629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 441/874] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:06.837260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28904f-52ee-4c65-bc3a-442892fa250b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:06.837558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28904f-52ee-4c65-bc3a-442892fa250b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:06.837842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28904f-52ee-4c65-bc3a-442892fa250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:06.859920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4b28904f-52ee-4c65-bc3a-442892fa250b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:06.861182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4b28904f-52ee-4c65-bc3a-442892fa250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:06.947222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 434/875] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:06 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:06.970111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fc3f5-a905-4755-b6a9-5c6fe1dd7c6d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:07.076895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fc3f5-a905-4755-b6a9-5c6fe1dd7c6d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:07.112332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb7fd9-347a-4e08-8972-b3afc0405b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:07.113170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb7fd9-347a-4e08-8972-b3afc0405b8b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:07.113592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb7fd9-347a-4e08-8972-b3afc0405b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:07.114098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb7fd9-347a-4e08-8972-b3afc0405b8b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:07.114757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb7fd9-347a-4e08-8972-b3afc0405b8b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:07.116202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb7fd9-347a-4e08-8972-b3afc0405b8b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-2adb7fd9-347a-4e08-8972-b3afc0405b8b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:07.128444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:07.129796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:07.130646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:07.135027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 442/876] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jun 20 06:01:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:07.136438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28904f-52ee-4c65-bc3a-442892fa250b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:07.244233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28904f-52ee-4c65-bc3a-442892fa250b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:07.262876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:07.280533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237e512-932c-45a8-a8c7-fb306c822f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:07.281244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e512-932c-45a8-a8c7-fb306c822f3e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:07.281538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e512-932c-45a8-a8c7-fb306c822f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:07.281823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e512-932c-45a8-a8c7-fb306c822f3e None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:07.282539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237e512-932c-45a8-a8c7-fb306c822f3e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:07.282855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237e512-932c-45a8-a8c7-fb306c822f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:07.285014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237e512-932c-45a8-a8c7-fb306c822f3e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:07.290844 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 435/877] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jun 20 06:01:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:07.297987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb7fd9-347a-4e08-8972-b3afc0405b8b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:07.366368 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:07.411174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb7fd9-347a-4e08-8972-b3afc0405b8b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:07.447759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdadc0f-c17e-46a3-a7d2-634a0dbb3dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:07.448436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdadc0f-c17e-46a3-a7d2-634a0dbb3dec None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:07.448754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdadc0f-c17e-46a3-a7d2-634a0dbb3dec None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:07.449041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdadc0f-c17e-46a3-a7d2-634a0dbb3dec None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:07.449765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdadc0f-c17e-46a3-a7d2-634a0dbb3dec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:07.450076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdadc0f-c17e-46a3-a7d2-634a0dbb3dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:07.451465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdadc0f-c17e-46a3-a7d2-634a0dbb3dec None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:07.456558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 443/878] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jun 20 06:01:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:07.485961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2e231-91dc-4e8d-89b6-0c8b2f934347 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:07.486958 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2e231-91dc-4e8d-89b6-0c8b2f934347 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:07.487446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2e231-91dc-4e8d-89b6-0c8b2f934347 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:07.489799 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 436/879] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:07.498688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a63fa1-406b-4777-8e1a-17f5894f0795 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:07.498968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a63fa1-406b-4777-8e1a-17f5894f0795 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:07.499187 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a63fa1-406b-4777-8e1a-17f5894f0795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:07.518107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-88a63fa1-406b-4777-8e1a-17f5894f0795 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:07.519335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-88a63fa1-406b-4777-8e1a-17f5894f0795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:07.601975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 444/880] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:07.630927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2e231-91dc-4e8d-89b6-0c8b2f934347 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:07.737980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2e231-91dc-4e8d-89b6-0c8b2f934347 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:07.773555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfebca-c716-40b2-9307-a374070d08ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:07.774201 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfebca-c716-40b2-9307-a374070d08ce None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:07.774494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfebca-c716-40b2-9307-a374070d08ce None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:07.774774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfebca-c716-40b2-9307-a374070d08ce None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:07.775519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfebca-c716-40b2-9307-a374070d08ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:07.776920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfebca-c716-40b2-9307-a374070d08ce None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:07.793485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 437/881] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 06:01:07 2022] POST /identity/v3/services => generated 269 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:08.369791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97e052-af76-4577-85a6-49cb0e918c10 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.370309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97e052-af76-4577-85a6-49cb0e918c10 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.370387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97e052-af76-4577-85a6-49cb0e918c10 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.371966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 445/882] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:08.377095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbf390-f29f-44b1-a88d-58edf013b1dd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.377390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbf390-f29f-44b1-a88d-58edf013b1dd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.377661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbf390-f29f-44b1-a88d-58edf013b1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.396932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-06dbf390-f29f-44b1-a88d-58edf013b1dd None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:08.398105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-06dbf390-f29f-44b1-a88d-58edf013b1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:08.436383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:08.477137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 438/883] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:08.500956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97e052-af76-4577-85a6-49cb0e918c10 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:08.565489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:08.611738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97e052-af76-4577-85a6-49cb0e918c10 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:08.649367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f72b6-1f01-480a-af0e-2f23e9e52b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:08.650181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f72b6-1f01-480a-af0e-2f23e9e52b9a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.650465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f72b6-1f01-480a-af0e-2f23e9e52b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.650744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f72b6-1f01-480a-af0e-2f23e9e52b9a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.662871 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f72b6-1f01-480a-af0e-2f23e9e52b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-568f72b6-1f01-480a-af0e-2f23e9e52b9a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:08.670930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:08.671888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:08.672786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 446/884] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jun 20 06:01:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:08.678977 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbf390-f29f-44b1-a88d-58edf013b1dd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:08.791178 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbf390-f29f-44b1-a88d-58edf013b1dd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:08.826591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab7e68-a33e-4521-a7b2-96329fa5a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:08.827592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7e68-a33e-4521-a7b2-96329fa5a75b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.828087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7e68-a33e-4521-a7b2-96329fa5a75b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.828575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7e68-a33e-4521-a7b2-96329fa5a75b None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.829557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab7e68-a33e-4521-a7b2-96329fa5a75b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:08.830111 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab7e68-a33e-4521-a7b2-96329fa5a75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:08.831702 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab7e68-a33e-4521-a7b2-96329fa5a75b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:08.841267 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 439/885] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jun 20 06:01:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:08.848636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f72b6-1f01-480a-af0e-2f23e9e52b9a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:08.886921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130060ea-d8d4-4b4e-86ec-a5674b98a51c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.887238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130060ea-d8d4-4b4e-86ec-a5674b98a51c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.887426 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130060ea-d8d4-4b4e-86ec-a5674b98a51c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.889086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 440/886] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:01:08.894118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491cf3c-93cc-425a-a376-cbfa53456315 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.894410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491cf3c-93cc-425a-a376-cbfa53456315 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.895017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491cf3c-93cc-425a-a376-cbfa53456315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.913558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0491cf3c-93cc-425a-a376-cbfa53456315 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:08.914855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0491cf3c-93cc-425a-a376-cbfa53456315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:08.948305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:08.956475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f72b6-1f01-480a-af0e-2f23e9e52b9a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:08.979943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:09.002171 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669487b-c06c-400c-9897-22fd7b1936af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.002983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669487b-c06c-400c-9897-22fd7b1936af None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.003266 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669487b-c06c-400c-9897-22fd7b1936af None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.003540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669487b-c06c-400c-9897-22fd7b1936af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.005016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 441/887] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:09.017788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669487b-c06c-400c-9897-22fd7b1936af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.018785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491cf3c-93cc-425a-a376-cbfa53456315 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.019055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669487b-c06c-400c-9897-22fd7b1936af None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-e669487b-c06c-400c-9897-22fd7b1936af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:09.043692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:09.044744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:09.045648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:09.045648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:09.045648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:09.045648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:09.046385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 447/888] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:09.052308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669487b-c06c-400c-9897-22fd7b1936af None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.125657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491cf3c-93cc-425a-a376-cbfa53456315 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.159488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669487b-c06c-400c-9897-22fd7b1936af None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.164269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0f3b3-e3e7-4b56-b8f3-a8d57033fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.165189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f3b3-e3e7-4b56-b8f3-a8d57033fbae None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.165551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f3b3-e3e7-4b56-b8f3-a8d57033fbae None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.165903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f3b3-e3e7-4b56-b8f3-a8d57033fbae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.166637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0f3b3-e3e7-4b56-b8f3-a8d57033fbae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.168206 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0f3b3-e3e7-4b56-b8f3-a8d57033fbae None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-fdb0f3b3-e3e7-4b56-b8f3-a8d57033fbae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:09.181480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:09.183584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 06:01:09.185628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:09.189039 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 442/889] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:09.192016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0f3b3-e3e7-4b56-b8f3-a8d57033fbae None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.195624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff4168-d23c-48cb-bb0f-b2b72a41f759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.196308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff4168-d23c-48cb-bb0f-b2b72a41f759 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.196598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff4168-d23c-48cb-bb0f-b2b72a41f759 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.196907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff4168-d23c-48cb-bb0f-b2b72a41f759 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.197644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff4168-d23c-48cb-bb0f-b2b72a41f759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:09.197958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff4168-d23c-48cb-bb0f-b2b72a41f759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.199350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff4168-d23c-48cb-bb0f-b2b72a41f759 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.217172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 448/890] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:09.218040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff4168-d23c-48cb-bb0f-b2b72a41f759 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.222544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:09.252810 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:09.323106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0f3b3-e3e7-4b56-b8f3-a8d57033fbae None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.332863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff4168-d23c-48cb-bb0f-b2b72a41f759 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.365965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31841429-a1f8-4828-b4db-a3913684f609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.366789 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31841429-a1f8-4828-b4db-a3913684f609 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.367190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31841429-a1f8-4828-b4db-a3913684f609 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.367560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31841429-a1f8-4828-b4db-a3913684f609 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.368483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31841429-a1f8-4828-b4db-a3913684f609 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:09.368986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31841429-a1f8-4828-b4db-a3913684f609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.370463 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31841429-a1f8-4828-b4db-a3913684f609 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.374712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5410e-79bc-48ae-b988-638929f5aeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.375646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5410e-79bc-48ae-b988-638929f5aeed None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.376002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5410e-79bc-48ae-b988-638929f5aeed None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.376351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5410e-79bc-48ae-b988-638929f5aeed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.376703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 443/891] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:09.382960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31841429-a1f8-4828-b4db-a3913684f609 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.389169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5410e-79bc-48ae-b988-638929f5aeed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.390724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5410e-79bc-48ae-b988-638929f5aeed None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-fcc5410e-79bc-48ae-b988-638929f5aeed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:09.406473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:09.408200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:09.414535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:09.414535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:09.414535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:09.414535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:09.414535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:09.414535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:09.414535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:09.414535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:09.414535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:01:09.414535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:09.414535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 449/892] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:09.416566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5410e-79bc-48ae-b988-638929f5aeed None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.498512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:09.513866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31841429-a1f8-4828-b4db-a3913684f609 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.516333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:09.529087 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5410e-79bc-48ae-b988-638929f5aeed None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.558360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18484b8b-b191-40a4-b754-614747590f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.559227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18484b8b-b191-40a4-b754-614747590f84 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.559532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18484b8b-b191-40a4-b754-614747590f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.559818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18484b8b-b191-40a4-b754-614747590f84 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.560921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18484b8b-b191-40a4-b754-614747590f84 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:09.561249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18484b8b-b191-40a4-b754-614747590f84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.563100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18484b8b-b191-40a4-b754-614747590f84 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.569739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd198f0c-5cc5-4332-900f-7c51cd493237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.570674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd198f0c-5cc5-4332-900f-7c51cd493237 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.571183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd198f0c-5cc5-4332-900f-7c51cd493237 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.571616 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd198f0c-5cc5-4332-900f-7c51cd493237 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.572758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd198f0c-5cc5-4332-900f-7c51cd493237 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:09.573289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd198f0c-5cc5-4332-900f-7c51cd493237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.575057 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 444/893] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:09.575413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd198f0c-5cc5-4332-900f-7c51cd493237 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.575938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18484b8b-b191-40a4-b754-614747590f84 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.600867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 450/894] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:09.602054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd198f0c-5cc5-4332-900f-7c51cd493237 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.692886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18484b8b-b191-40a4-b754-614747590f84 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.728058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899aa1f-3b53-48e8-b83d-367eaaa23a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.729013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899aa1f-3b53-48e8-b83d-367eaaa23a17 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.729303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899aa1f-3b53-48e8-b83d-367eaaa23a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.729586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899aa1f-3b53-48e8-b83d-367eaaa23a17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.730390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899aa1f-3b53-48e8-b83d-367eaaa23a17 None admin] RBAC: Adding query filter params (interface=public, service_id=52f3759271e146f980262f33658c0de4, region_id=RegionOne) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:09.730709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899aa1f-3b53-48e8-b83d-367eaaa23a17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.731944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd198f0c-5cc5-4332-900f-7c51cd493237 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.732120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899aa1f-3b53-48e8-b83d-367eaaa23a17 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.741978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 445/895] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/endpoints?service_id=52f3759271e146f980262f33658c0de4&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:09.741978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd6793-f906-4019-a305-c47c7ad2cf3e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.741978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd6793-f906-4019-a305-c47c7ad2cf3e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.741978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd6793-f906-4019-a305-c47c7ad2cf3e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.741978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 446/896] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:09.742652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd6793-f906-4019-a305-c47c7ad2cf3e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:09.765025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:09.773930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28040-f808-4d27-8d92-dddf226af4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.774592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28040-f808-4d27-8d92-dddf226af4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.774880 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28040-f808-4d27-8d92-dddf226af4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.775162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28040-f808-4d27-8d92-dddf226af4f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.794248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:09.858345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd6793-f906-4019-a305-c47c7ad2cf3e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:09.858786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b28040-f808-4d27-8d92-dddf226af4f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.860309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b28040-f808-4d27-8d92-dddf226af4f7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.892218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bf99c-b61d-4fd1-9174-12b56d731ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:09.892922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bf99c-b61d-4fd1-9174-12b56d731ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.893213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bf99c-b61d-4fd1-9174-12b56d731ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.893499 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bf99c-b61d-4fd1-9174-12b56d731ab1 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.894187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bf99c-b61d-4fd1-9174-12b56d731ab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:09.896115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bf99c-b61d-4fd1-9174-12b56d731ab1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:09.901812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 447/897] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:01:09.903055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3be4e7-2fed-484c-8d49-dc84aae20ca5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:09.903350 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3be4e7-2fed-484c-8d49-dc84aae20ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:09.903639 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3be4e7-2fed-484c-8d49-dc84aae20ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:09.925259 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4d3be4e7-2fed-484c-8d49-dc84aae20ca5 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:09.927304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4d3be4e7-2fed-484c-8d49-dc84aae20ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:09.985342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 451/898] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:09.992372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28040-f808-4d27-8d92-dddf226af4f7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.024237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 448/899] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:10.049263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3be4e7-2fed-484c-8d49-dc84aae20ca5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.062531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.070559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.131761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28040-f808-4d27-8d92-dddf226af4f7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.168426 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3be4e7-2fed-484c-8d49-dc84aae20ca5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.169898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeacdf9-b87c-4500-801c-219682654457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.170693 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeacdf9-b87c-4500-801c-219682654457 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.170967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeacdf9-b87c-4500-801c-219682654457 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.171252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeacdf9-b87c-4500-801c-219682654457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.183171 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeacdf9-b87c-4500-801c-219682654457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.184657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeacdf9-b87c-4500-801c-219682654457 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-aaeacdf9-b87c-4500-801c-219682654457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:10.203147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:10.204354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:10.205596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:10.205596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:10.205596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:10.205596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:10.209895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9746f-c2f5-4079-8930-7906e1ebcc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.210166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 452/900] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:10.210578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9746f-c2f5-4079-8930-7906e1ebcc93 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.210866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9746f-c2f5-4079-8930-7906e1ebcc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.211149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9746f-c2f5-4079-8930-7906e1ebcc93 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.211485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105312-896f-416c-8757-d3f5308cd23d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.211774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105312-896f-416c-8757-d3f5308cd23d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.211881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9746f-c2f5-4079-8930-7906e1ebcc93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.212052 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105312-896f-416c-8757-d3f5308cd23d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.213507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 453/901] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:10.213631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9746f-c2f5-4079-8930-7906e1ebcc93 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.217490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72105312-896f-416c-8757-d3f5308cd23d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.230381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 449/902] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 06:01:10 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:10.231669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566ff70-1a39-4049-a308-b7c938e22a33 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.231967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566ff70-1a39-4049-a308-b7c938e22a33 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.232252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566ff70-1a39-4049-a308-b7c938e22a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.252380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c566ff70-1a39-4049-a308-b7c938e22a33 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:10.254474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c566ff70-1a39-4049-a308-b7c938e22a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:10.334975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.349939 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 450/903] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:10.369100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.374921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566ff70-1a39-4049-a308-b7c938e22a33 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.376763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72105312-896f-416c-8757-d3f5308cd23d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.424371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96afa26-9ff3-46a8-8a39-2d6eb2c8d4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.425932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96afa26-9ff3-46a8-8a39-2d6eb2c8d4ba None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.426227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96afa26-9ff3-46a8-8a39-2d6eb2c8d4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.426535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96afa26-9ff3-46a8-8a39-2d6eb2c8d4ba None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.427337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96afa26-9ff3-46a8-8a39-2d6eb2c8d4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:10.427654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96afa26-9ff3-46a8-8a39-2d6eb2c8d4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.430009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96afa26-9ff3-46a8-8a39-2d6eb2c8d4ba None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.445929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 454/904] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:10.453508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96afa26-9ff3-46a8-8a39-2d6eb2c8d4ba None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.508605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566ff70-1a39-4049-a308-b7c938e22a33 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.558540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84cf9d-b4da-44f2-b3ab-75c7671ba222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.559618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84cf9d-b4da-44f2-b3ab-75c7671ba222 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.559913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84cf9d-b4da-44f2-b3ab-75c7671ba222 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.560196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84cf9d-b4da-44f2-b3ab-75c7671ba222 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.560916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84cf9d-b4da-44f2-b3ab-75c7671ba222 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.563160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84cf9d-b4da-44f2-b3ab-75c7671ba222 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4a84cf9d-b4da-44f2-b3ab-75c7671ba222 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:10.580453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:10.581539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:10.588217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 451/905] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:10.589150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96afa26-9ff3-46a8-8a39-2d6eb2c8d4ba None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.590779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84cf9d-b4da-44f2-b3ab-75c7671ba222 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.634374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71825c-8052-4bd9-9dac-6092843b826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.635237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71825c-8052-4bd9-9dac-6092843b826c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.635537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71825c-8052-4bd9-9dac-6092843b826c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.635824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71825c-8052-4bd9-9dac-6092843b826c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.645545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71825c-8052-4bd9-9dac-6092843b826c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.647305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71825c-8052-4bd9-9dac-6092843b826c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.662524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-7f71825c-8052-4bd9-9dac-6092843b826c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:10.670111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:10.671060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:10.672364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:10.672364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:10.672364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:10.672364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:10.672364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:10.672364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:10.672364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:10.672364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:10.676396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 455/906] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:10.677288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71825c-8052-4bd9-9dac-6092843b826c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.707761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.717748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84cf9d-b4da-44f2-b3ab-75c7671ba222 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.755752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fb8ac-fd7e-4017-bff1-375f5dccf370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.756804 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fb8ac-fd7e-4017-bff1-375f5dccf370 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.757289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fb8ac-fd7e-4017-bff1-375f5dccf370 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.757805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fb8ac-fd7e-4017-bff1-375f5dccf370 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.758516 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fb8ac-fd7e-4017-bff1-375f5dccf370 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:10.758879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fb8ac-fd7e-4017-bff1-375f5dccf370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.761716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fb8ac-fd7e-4017-bff1-375f5dccf370 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.772448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 452/907] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:10.773337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fb8ac-fd7e-4017-bff1-375f5dccf370 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.812316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71825c-8052-4bd9-9dac-6092843b826c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.854205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b318de-230c-4cd0-a0a3-32685c219044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.854869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b318de-230c-4cd0-a0a3-32685c219044 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.855409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b318de-230c-4cd0-a0a3-32685c219044 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.855687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b318de-230c-4cd0-a0a3-32685c219044 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.856895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b318de-230c-4cd0-a0a3-32685c219044 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:10.857474 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b318de-230c-4cd0-a0a3-32685c219044 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.858924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b318de-230c-4cd0-a0a3-32685c219044 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.875788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 456/908] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:10.881531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b318de-230c-4cd0-a0a3-32685c219044 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.902954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fb8ac-fd7e-4017-bff1-375f5dccf370 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.929401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:10.942611 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48399e-afb4-4ed6-a266-edbf829bcdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.943291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48399e-afb4-4ed6-a266-edbf829bcdcc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.943582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48399e-afb4-4ed6-a266-edbf829bcdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.943866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48399e-afb4-4ed6-a266-edbf829bcdcc None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.944791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48399e-afb4-4ed6-a266-edbf829bcdcc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:10.945108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48399e-afb4-4ed6-a266-edbf829bcdcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.946629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48399e-afb4-4ed6-a266-edbf829bcdcc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.952298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 453/909] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:10.961670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48399e-afb4-4ed6-a266-edbf829bcdcc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.996943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:11.030404 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b318de-230c-4cd0-a0a3-32685c219044 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:11.079037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8eeb2-fd42-4cc3-b0b5-b14502f233f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:11.079715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8eeb2-fd42-4cc3-b0b5-b14502f233f7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:11.080372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8eeb2-fd42-4cc3-b0b5-b14502f233f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:11.080690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8eeb2-fd42-4cc3-b0b5-b14502f233f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:11.081821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8eeb2-fd42-4cc3-b0b5-b14502f233f7 None admin] RBAC: Adding query filter params (role.id=aabc773ecbd1409e8482cff30512ac1e, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=6c8e272684d542caaaecce191467edc6) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:11.082766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8eeb2-fd42-4cc3-b0b5-b14502f233f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:11.085729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8eeb2-fd42-4cc3-b0b5-b14502f233f7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:11.087509 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48399e-afb4-4ed6-a266-edbf829bcdcc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:11.093108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 457/910] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/role_assignments?user.id=6c8e272684d542caaaecce191467edc6&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=aabc773ecbd1409e8482cff30512ac1e => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:11.136796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e160f-c5ad-4d14-8189-9645e4abfdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:11.137483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e160f-c5ad-4d14-8189-9645e4abfdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:11.137777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e160f-c5ad-4d14-8189-9645e4abfdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:11.138063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e160f-c5ad-4d14-8189-9645e4abfdf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:11.138877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e160f-c5ad-4d14-8189-9645e4abfdf4 None admin] RBAC: Adding query filter params (interface=public, service_id=f3e25d8defca4c64bf33155197cc4e36, region_id=RegionOne) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:11.139197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e160f-c5ad-4d14-8189-9645e4abfdf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:11.140600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e160f-c5ad-4d14-8189-9645e4abfdf4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:11.147131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 454/911] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/endpoints?service_id=f3e25d8defca4c64bf33155197cc4e36&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:11.152777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8eeb2-fd42-4cc3-b0b5-b14502f233f7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:11.272455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8eeb2-fd42-4cc3-b0b5-b14502f233f7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:11.308110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4ef66-2a53-43a8-af37-ccc0997e9e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:11.308729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ef66-2a53-43a8-af37-ccc0997e9e15 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:11.309024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ef66-2a53-43a8-af37-ccc0997e9e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:11.309305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ef66-2a53-43a8-af37-ccc0997e9e15 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:11.309992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4ef66-2a53-43a8-af37-ccc0997e9e15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:11.311385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4ef66-2a53-43a8-af37-ccc0997e9e15 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:11.318519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 458/912] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jun 20 06:01:11 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:01:12.054458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd304b6e-4eda-409a-8547-0bc000a3ef91 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.055152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd304b6e-4eda-409a-8547-0bc000a3ef91 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.055152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd304b6e-4eda-409a-8547-0bc000a3ef91 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.056590 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 455/913] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:12.061800 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc85d2-a6af-4e4b-9e02-066e31f4b7cc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.062296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc85d2-a6af-4e4b-9e02-066e31f4b7cc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.062466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc85d2-a6af-4e4b-9e02-066e31f4b7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.079515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-18fc85d2-a6af-4e4b-9e02-066e31f4b7cc None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:12.080735 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-18fc85d2-a6af-4e4b-9e02-066e31f4b7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:12.083518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:12.152285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 459/914] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:12.175452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd304b6e-4eda-409a-8547-0bc000a3ef91 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:12.234806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:12.288285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd304b6e-4eda-409a-8547-0bc000a3ef91 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:12.324256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e8e18-8db5-4a88-9572-b8336fbacbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:12.325007 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e8e18-8db5-4a88-9572-b8336fbacbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.325293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e8e18-8db5-4a88-9572-b8336fbacbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.325574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e8e18-8db5-4a88-9572-b8336fbacbd0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.326244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e8e18-8db5-4a88-9572-b8336fbacbd0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:12.327621 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e8e18-8db5-4a88-9572-b8336fbacbd0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-638e8e18-8db5-4a88-9572-b8336fbacbd0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:12.340333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:12.342606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:12.344671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 456/915] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:01:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:12.349558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc85d2-a6af-4e4b-9e02-066e31f4b7cc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:12.428398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85133bf-704a-4c07-8448-6f681293be16 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.428398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85133bf-704a-4c07-8448-6f681293be16 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.428398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85133bf-704a-4c07-8448-6f681293be16 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.435837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 457/916] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:01:12.435837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ec44f-a46a-4421-9298-c2ccad98cbc9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.435837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ec44f-a46a-4421-9298-c2ccad98cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.435837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ec44f-a46a-4421-9298-c2ccad98cbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.453440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc85d2-a6af-4e4b-9e02-066e31f4b7cc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:12.454089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e28ec44f-a46a-4421-9298-c2ccad98cbc9 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:12.456479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e28ec44f-a46a-4421-9298-c2ccad98cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:12.491043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683988a-bb4e-4d7c-bba0-11bb8f5af376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:12.492343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683988a-bb4e-4d7c-bba0-11bb8f5af376 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.492879 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683988a-bb4e-4d7c-bba0-11bb8f5af376 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.493374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683988a-bb4e-4d7c-bba0-11bb8f5af376 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.494377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683988a-bb4e-4d7c-bba0-11bb8f5af376 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:12.494940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683988a-bb4e-4d7c-bba0-11bb8f5af376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:12.497595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683988a-bb4e-4d7c-bba0-11bb8f5af376 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:12.504734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 460/917] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:01:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:12.510666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683988a-bb4e-4d7c-bba0-11bb8f5af376 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:12.516957 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:12.549219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 458/918] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:12.568563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ec44f-a46a-4421-9298-c2ccad98cbc9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:12.631474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:12.652123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683988a-bb4e-4d7c-bba0-11bb8f5af376 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:12.697917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ec44f-a46a-4421-9298-c2ccad98cbc9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:12.698792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292c7cd-6f51-48c9-973d-095a588de4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:12.699959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292c7cd-6f51-48c9-973d-095a588de4cd None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.701079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292c7cd-6f51-48c9-973d-095a588de4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.701193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292c7cd-6f51-48c9-973d-095a588de4cd None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.701905 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292c7cd-6f51-48c9-973d-095a588de4cd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:12.702224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292c7cd-6f51-48c9-973d-095a588de4cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:12.703619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292c7cd-6f51-48c9-973d-095a588de4cd None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:12.714156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 461/919] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jun 20 06:01:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:12.714965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292c7cd-6f51-48c9-973d-095a588de4cd None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:12.740731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda62de6-6458-4f35-b6fa-68dcb0ba4c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:12.742549 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda62de6-6458-4f35-b6fa-68dcb0ba4c9a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.743057 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda62de6-6458-4f35-b6fa-68dcb0ba4c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.743769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda62de6-6458-4f35-b6fa-68dcb0ba4c9a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.745351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda62de6-6458-4f35-b6fa-68dcb0ba4c9a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:12.747595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda62de6-6458-4f35-b6fa-68dcb0ba4c9a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-fda62de6-6458-4f35-b6fa-68dcb0ba4c9a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:12.765231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:12.766276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:12.767131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:12.776183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 459/920] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jun 20 06:01:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:12.776852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda62de6-6458-4f35-b6fa-68dcb0ba4c9a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:12.793042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:12.837318 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292c7cd-6f51-48c9-973d-095a588de4cd None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:12.882044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc26b4e-c41b-4465-a390-fe798aeeac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:12.883079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc26b4e-c41b-4465-a390-fe798aeeac25 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.883935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc26b4e-c41b-4465-a390-fe798aeeac25 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.884411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc26b4e-c41b-4465-a390-fe798aeeac25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.885799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc26b4e-c41b-4465-a390-fe798aeeac25 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:12.887902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc26b4e-c41b-4465-a390-fe798aeeac25 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:12.910974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda62de6-6458-4f35-b6fa-68dcb0ba4c9a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:12.915675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 462/921] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jun 20 06:01:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:01:12.932800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:12.971929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44e402-c0e1-417d-9203-a564cbdc420c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:12.973955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44e402-c0e1-417d-9203-a564cbdc420c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.974534 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44e402-c0e1-417d-9203-a564cbdc420c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.975034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44e402-c0e1-417d-9203-a564cbdc420c None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.976111 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44e402-c0e1-417d-9203-a564cbdc420c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:12.976698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44e402-c0e1-417d-9203-a564cbdc420c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:12.978433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44e402-c0e1-417d-9203-a564cbdc420c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:12.985110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 460/922] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jun 20 06:01:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:12.991859 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc26b4e-c41b-4465-a390-fe798aeeac25 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.108928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc26b4e-c41b-4465-a390-fe798aeeac25 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.138677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.155713 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9e6c1-0cdc-46ea-a6d5-9ff27b169678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.156399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9e6c1-0cdc-46ea-a6d5-9ff27b169678 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.156727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9e6c1-0cdc-46ea-a6d5-9ff27b169678 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.157080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9e6c1-0cdc-46ea-a6d5-9ff27b169678 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.157810 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9e6c1-0cdc-46ea-a6d5-9ff27b169678 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:13.158128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9e6c1-0cdc-46ea-a6d5-9ff27b169678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.159776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9e6c1-0cdc-46ea-a6d5-9ff27b169678 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.166234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 463/923] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jun 20 06:01:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:13.171914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44e402-c0e1-417d-9203-a564cbdc420c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.236455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d1b0d-8591-4590-8e66-061bf88b76e7 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.236786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d1b0d-8591-4590-8e66-061bf88b76e7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.237098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d1b0d-8591-4590-8e66-061bf88b76e7 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.240412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 464/924] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:13.244550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a3bc2-82fc-4d97-b22c-c520e8c4e1d2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.244803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a3bc2-82fc-4d97-b22c-c520e8c4e1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.245066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a3bc2-82fc-4d97-b22c-c520e8c4e1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.262816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-554a3bc2-82fc-4d97-b22c-c520e8c4e1d2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:13.263992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-554a3bc2-82fc-4d97-b22c-c520e8c4e1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:13.291118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44e402-c0e1-417d-9203-a564cbdc420c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.338426 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74087d01-dd98-4a1f-b1e3-44cc8de90e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.339734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74087d01-dd98-4a1f-b1e3-44cc8de90e8f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.340226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74087d01-dd98-4a1f-b1e3-44cc8de90e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.340765 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74087d01-dd98-4a1f-b1e3-44cc8de90e8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.341761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74087d01-dd98-4a1f-b1e3-44cc8de90e8f None admin] RBAC: Adding query filter params (interface=public, service_id=4eb1810c664c4613adfa61d966b6b328, region_id=RegionOne) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:13.342291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74087d01-dd98-4a1f-b1e3-44cc8de90e8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.343952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74087d01-dd98-4a1f-b1e3-44cc8de90e8f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.348734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 465/925] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:13.350370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 461/926] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/endpoints?service_id=4eb1810c664c4613adfa61d966b6b328&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:13.356010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a3bc2-82fc-4d97-b22c-c520e8c4e1d2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.368999 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74087d01-dd98-4a1f-b1e3-44cc8de90e8f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.416170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.476937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a3bc2-82fc-4d97-b22c-c520e8c4e1d2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.496635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.499042 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74087d01-dd98-4a1f-b1e3-44cc8de90e8f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.518532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c370e-634d-4982-8308-f4a457edeefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.519188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c370e-634d-4982-8308-f4a457edeefb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.520085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c370e-634d-4982-8308-f4a457edeefb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.521075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c370e-634d-4982-8308-f4a457edeefb None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.521779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c370e-634d-4982-8308-f4a457edeefb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.523162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c370e-634d-4982-8308-f4a457edeefb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.536647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 466/927] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:01:13.536647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e277820-637f-468c-823d-30f743689c23 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.536647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e277820-637f-468c-823d-30f743689c23 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.536647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e277820-637f-468c-823d-30f743689c23 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.536647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 467/928] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:13.539078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66665f-0d31-4371-9c27-d64c053b3c12 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.539373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66665f-0d31-4371-9c27-d64c053b3c12 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.539649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66665f-0d31-4371-9c27-d64c053b3c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.544775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157906fe-9307-42fa-8aef-0dbc558c3e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.545621 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157906fe-9307-42fa-8aef-0dbc558c3e3d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.545913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157906fe-9307-42fa-8aef-0dbc558c3e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.546198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157906fe-9307-42fa-8aef-0dbc558c3e3d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.559311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157906fe-9307-42fa-8aef-0dbc558c3e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:13.559890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7c66665f-0d31-4371-9c27-d64c053b3c12 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:13.561334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7c66665f-0d31-4371-9c27-d64c053b3c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-157906fe-9307-42fa-8aef-0dbc558c3e3d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:13.568668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:13.569722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:13.570581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:13.575453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 462/929] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:13.576438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157906fe-9307-42fa-8aef-0dbc558c3e3d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.669366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 468/930] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:13.692076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66665f-0d31-4371-9c27-d64c053b3c12 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.703988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.713960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157906fe-9307-42fa-8aef-0dbc558c3e3d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.759614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5186f-c2f1-4da8-ba1c-c7e8438f8a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.760811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5186f-c2f1-4da8-ba1c-c7e8438f8a4b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.761110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5186f-c2f1-4da8-ba1c-c7e8438f8a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.761443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5186f-c2f1-4da8-ba1c-c7e8438f8a4b None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.762209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5186f-c2f1-4da8-ba1c-c7e8438f8a4b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:13.762790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5186f-c2f1-4da8-ba1c-c7e8438f8a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.764360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5186f-c2f1-4da8-ba1c-c7e8438f8a4b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.775575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 463/931] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:13.781566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5186f-c2f1-4da8-ba1c-c7e8438f8a4b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.823684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66665f-0d31-4371-9c27-d64c053b3c12 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.836125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:13.861908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30882b-56d9-4223-a992-0083a603f1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.862730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30882b-56d9-4223-a992-0083a603f1dc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.863023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30882b-56d9-4223-a992-0083a603f1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.863825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30882b-56d9-4223-a992-0083a603f1dc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.864584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30882b-56d9-4223-a992-0083a603f1dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.866134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30882b-56d9-4223-a992-0083a603f1dc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3e30882b-56d9-4223-a992-0083a603f1dc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:13.879816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:13.880843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:13.887152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 469/932] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:13.889677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30882b-56d9-4223-a992-0083a603f1dc None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:13.903192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5186f-c2f1-4da8-ba1c-c7e8438f8a4b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.948195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae49c76-e85e-4077-96d5-6b4195b11b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.949349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae49c76-e85e-4077-96d5-6b4195b11b49 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.949950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae49c76-e85e-4077-96d5-6b4195b11b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.950442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae49c76-e85e-4077-96d5-6b4195b11b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.962669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae49c76-e85e-4077-96d5-6b4195b11b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.964552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae49c76-e85e-4077-96d5-6b4195b11b49 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-dae49c76-e85e-4077-96d5-6b4195b11b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:13.983380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:13.984338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:13.985286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:13.985286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:13.985286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:13.985286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:13.987645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 464/933] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:13.993840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae49c76-e85e-4077-96d5-6b4195b11b49 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.007493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:14.013665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30882b-56d9-4223-a992-0083a603f1dc None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.049517 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4799e-1db6-4ca9-9019-acfd6030e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.050193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4799e-1db6-4ca9-9019-acfd6030e3be None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.050553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4799e-1db6-4ca9-9019-acfd6030e3be None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.051302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4799e-1db6-4ca9-9019-acfd6030e3be None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.052032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4799e-1db6-4ca9-9019-acfd6030e3be None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:14.052349 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4799e-1db6-4ca9-9019-acfd6030e3be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.053808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4799e-1db6-4ca9-9019-acfd6030e3be None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.063357 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 470/934] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:14.065543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4799e-1db6-4ca9-9019-acfd6030e3be None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.118381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:14.127522 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae49c76-e85e-4077-96d5-6b4195b11b49 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.166740 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8310d-4bd1-4e77-b5c4-079975cdcad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.167882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8310d-4bd1-4e77-b5c4-079975cdcad7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.168373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8310d-4bd1-4e77-b5c4-079975cdcad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.169084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8310d-4bd1-4e77-b5c4-079975cdcad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.170110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8310d-4bd1-4e77-b5c4-079975cdcad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:14.170622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8310d-4bd1-4e77-b5c4-079975cdcad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.172288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8310d-4bd1-4e77-b5c4-079975cdcad7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.184046 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4799e-1db6-4ca9-9019-acfd6030e3be None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.186634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 465/935] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:14.192909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8310d-4bd1-4e77-b5c4-079975cdcad7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.226144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca39ba-cd29-47ab-9fdb-213d7a9e7786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.226738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca39ba-cd29-47ab-9fdb-213d7a9e7786 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.227027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca39ba-cd29-47ab-9fdb-213d7a9e7786 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.227308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca39ba-cd29-47ab-9fdb-213d7a9e7786 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.228025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca39ba-cd29-47ab-9fdb-213d7a9e7786 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:14.228388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca39ba-cd29-47ab-9fdb-213d7a9e7786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.229862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca39ba-cd29-47ab-9fdb-213d7a9e7786 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.240213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 471/936] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:14.241763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca39ba-cd29-47ab-9fdb-213d7a9e7786 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.276672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:14.317355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8310d-4bd1-4e77-b5c4-079975cdcad7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.357170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57dda3-ed8e-43c0-bf42-ca31b3112019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.357373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca39ba-cd29-47ab-9fdb-213d7a9e7786 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.358461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57dda3-ed8e-43c0-bf42-ca31b3112019 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.358906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:14.359395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57dda3-ed8e-43c0-bf42-ca31b3112019 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.360539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57dda3-ed8e-43c0-bf42-ca31b3112019 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.370149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57dda3-ed8e-43c0-bf42-ca31b3112019 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.371988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57dda3-ed8e-43c0-bf42-ca31b3112019 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-3c57dda3-ed8e-43c0-bf42-ca31b3112019 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:14.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:14.389763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:14.390963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:14.390963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:14.390963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:14.390963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:14.390963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:14.390963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:14.390963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:14.390963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:14.390963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:01:14.390963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:14.395099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 466/937] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:14.400443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9690-272d-41ac-99ac-79dbdce79b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.401015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57dda3-ed8e-43c0-bf42-ca31b3112019 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.401170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9690-272d-41ac-99ac-79dbdce79b3d None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.401437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9690-272d-41ac-99ac-79dbdce79b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.401718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9690-272d-41ac-99ac-79dbdce79b3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.402501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae9690-272d-41ac-99ac-79dbdce79b3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.403832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae9690-272d-41ac-99ac-79dbdce79b3d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.432638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 472/938] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jun 20 06:01:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:01:14.525030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57dda3-ed8e-43c0-bf42-ca31b3112019 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.555546 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:14.571222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff50d-9ecd-4156-aab7-330ceb533178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.571910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff50d-9ecd-4156-aab7-330ceb533178 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.572198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff50d-9ecd-4156-aab7-330ceb533178 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.572476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff50d-9ecd-4156-aab7-330ceb533178 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.573444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ff50d-9ecd-4156-aab7-330ceb533178 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:14.573761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ff50d-9ecd-4156-aab7-330ceb533178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.575302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ff50d-9ecd-4156-aab7-330ceb533178 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.600226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 467/939] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:14.605588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9690-272d-41ac-99ac-79dbdce79b3d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.730396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9690-272d-41ac-99ac-79dbdce79b3d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.766989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e880c0-f4da-48d4-b8f2-f2239abfc990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.768191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e880c0-f4da-48d4-b8f2-f2239abfc990 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.768852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e880c0-f4da-48d4-b8f2-f2239abfc990 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.769335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e880c0-f4da-48d4-b8f2-f2239abfc990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.781303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e880c0-f4da-48d4-b8f2-f2239abfc990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.783028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e880c0-f4da-48d4-b8f2-f2239abfc990 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-67e880c0-f4da-48d4-b8f2-f2239abfc990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:14.803097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:14.804075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:14.805047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:14.805047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:14.805047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:14.805047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:14.807364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 473/940] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:14.813975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff50d-9ecd-4156-aab7-330ceb533178 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.922376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff50d-9ecd-4156-aab7-330ceb533178 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:14.958502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc093aa-8090-4583-852f-747808db29f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:14.959172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc093aa-8090-4583-852f-747808db29f0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:14.959454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc093aa-8090-4583-852f-747808db29f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:14.959731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc093aa-8090-4583-852f-747808db29f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:14.960453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc093aa-8090-4583-852f-747808db29f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:14.960793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc093aa-8090-4583-852f-747808db29f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:14.962252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc093aa-8090-4583-852f-747808db29f0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:14.974995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 468/941] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:14.980452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e880c0-f4da-48d4-b8f2-f2239abfc990 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:14.994353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:15.052445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe5f1c-cc4b-4c34-b778-2466927a920c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.052670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe5f1c-cc4b-4c34-b778-2466927a920c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.052951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe5f1c-cc4b-4c34-b778-2466927a920c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.054452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 469/942] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:01:15.059532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ede96b-bf96-4a98-bb96-df81ce8e7539 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.059823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ede96b-bf96-4a98-bb96-df81ce8e7539 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.060110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ede96b-bf96-4a98-bb96-df81ce8e7539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.077944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e4ede96b-bf96-4a98-bb96-df81ce8e7539 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:15.079149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e4ede96b-bf96-4a98-bb96-df81ce8e7539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:15.095106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e880c0-f4da-48d4-b8f2-f2239abfc990 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:15.124036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:15.137907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b2f62-449f-418c-a9bc-7a3b0e7dd1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:15.138826 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b2f62-449f-418c-a9bc-7a3b0e7dd1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.139117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b2f62-449f-418c-a9bc-7a3b0e7dd1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.139540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b2f62-449f-418c-a9bc-7a3b0e7dd1b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.147058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b2f62-449f-418c-a9bc-7a3b0e7dd1b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:15.148534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b2f62-449f-418c-a9bc-7a3b0e7dd1b0 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3a0b2f62-449f-418c-a9bc-7a3b0e7dd1b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:15.165237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:15.166151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:15.167070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:15.167070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:15.167070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:15.167070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:15.167070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:15.167070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:15.167070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:15.167070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:15.167070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 474/943] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:15.171302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 470/944] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:15.173560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b2f62-449f-418c-a9bc-7a3b0e7dd1b0 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:15.200730 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ede96b-bf96-4a98-bb96-df81ce8e7539 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:15.249153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:15.282763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b2f62-449f-418c-a9bc-7a3b0e7dd1b0 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:15.312907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ede96b-bf96-4a98-bb96-df81ce8e7539 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:15.320977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ce54e-8af4-44d2-8d59-b8f0f2f2a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:15.321673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ce54e-8af4-44d2-8d59-b8f0f2f2a81a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.321962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ce54e-8af4-44d2-8d59-b8f0f2f2a81a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.322240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ce54e-8af4-44d2-8d59-b8f0f2f2a81a None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.323202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ce54e-8af4-44d2-8d59-b8f0f2f2a81a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:15.323519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ce54e-8af4-44d2-8d59-b8f0f2f2a81a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:15.325057 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ce54e-8af4-44d2-8d59-b8f0f2f2a81a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:15.339181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 475/945] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:15.345123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ce54e-8af4-44d2-8d59-b8f0f2f2a81a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:15.354841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d0ee0-878c-4461-af12-65454c71fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:15.355998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d0ee0-878c-4461-af12-65454c71fd31 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.356509 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d0ee0-878c-4461-af12-65454c71fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.357146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d0ee0-878c-4461-af12-65454c71fd31 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.358029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d0ee0-878c-4461-af12-65454c71fd31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:15.359738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d0ee0-878c-4461-af12-65454c71fd31 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:15.361405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: WARNING keystone.server.flask.common [None req-821d0ee0-878c-4461-af12-65454c71fd31 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 06:01:15.382828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.sql.core [None req-821d0ee0-878c-4461-af12-65454c71fd31 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 06:01:15.382828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 06:01:15.382828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [parameters: {'id': 'c6b2ddbe63234707b4f2a2089397d5c8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 06:01:15.382828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80270) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-821d0ee0-878c-4461-af12-65454c71fd31 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c6b2ddbe63234707b4f2a2089397d5c8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c6b2ddbe63234707b4f2a2089397d5c8. Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application conn.query(q) Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 06:01:15.391600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application result.read() Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 20 06:01:15.392447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application next(self.gen) Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application yield resource Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application next(self.gen) Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise self.value Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application session.commit() Jun 20 06:01:15.393668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.session.flush() Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application compat.raise_( Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 06:01:15.395127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 06:01:15.396022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application conn.query(q) Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application result.read() Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 06:01:15.398443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [parameters: {'id': 'c6b2ddbe63234707b4f2a2089397d5c8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:15.400236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:15.401905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:15.403679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:15.403679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 20 06:01:15.403679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 20 06:01:15.403679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:15.403679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:15.403679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 20 06:01:15.403679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 20 06:01:15.403679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c6b2ddbe63234707b4f2a2089397d5c8. Jun 20 06:01:15.403679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:15.412094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 471/946] 10.222.0.40 () {60 vars in 1140 bytes} [Mon Jun 20 06:01:15 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:15.413847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d0ee0-878c-4461-af12-65454c71fd31 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:15.449255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:15.466086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ce54e-8af4-44d2-8d59-b8f0f2f2a81a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:15.497305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:15.504640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc216695-147c-4b4e-b5a9-3ad5e683ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:15.505636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216695-147c-4b4e-b5a9-3ad5e683ecd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.505996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216695-147c-4b4e-b5a9-3ad5e683ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.506344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc216695-147c-4b4e-b5a9-3ad5e683ecd7 None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/6c8e272684d542caaaecce191467edc6/roles/aabc773ecbd1409e8482cff30512ac1e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.508684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc216695-147c-4b4e-b5a9-3ad5e683ecd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=6c8e272684d542caaaecce191467edc6, role_id=aabc773ecbd1409e8482cff30512ac1e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:15.510332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc216695-147c-4b4e-b5a9-3ad5e683ecd7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:15.529004 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 476/947] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:01:15 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/6c8e272684d542caaaecce191467edc6/roles/aabc773ecbd1409e8482cff30512ac1e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:01:15.544228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d0ee0-878c-4461-af12-65454c71fd31 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:15.586068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5adb81-82ac-42eb-b550-a780df717a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:15.587078 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5adb81-82ac-42eb-b550-a780df717a77 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.587464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5adb81-82ac-42eb-b550-a780df717a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.587844 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5adb81-82ac-42eb-b550-a780df717a77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.596162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5adb81-82ac-42eb-b550-a780df717a77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:15.598733 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5adb81-82ac-42eb-b550-a780df717a77 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-9d5adb81-82ac-42eb-b550-a780df717a77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:15.616191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:15.617231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:15.618468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:15.618468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:15.618468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:15.618468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:15.618468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:15.618468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:15.618468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:15.618468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:15.618468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 472/948] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:15.627963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc216695-147c-4b4e-b5a9-3ad5e683ecd7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:15.708472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f4cc5-12c9-4b72-9b8d-c3a900f0e0ff None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.708858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f4cc5-12c9-4b72-9b8d-c3a900f0e0ff None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.709070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f4cc5-12c9-4b72-9b8d-c3a900f0e0ff None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.713850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 473/949] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:15.719700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674689b-381b-479b-b922-a557d4797489 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.720064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674689b-381b-479b-b922-a557d4797489 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.720418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674689b-381b-479b-b922-a557d4797489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.744422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2674689b-381b-479b-b922-a557d4797489 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:15.747155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2674689b-381b-479b-b922-a557d4797489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:15.753581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc216695-147c-4b4e-b5a9-3ad5e683ecd7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:15.790223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445d09b-228c-4816-b961-a5386db57842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:15.791205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445d09b-228c-4816-b961-a5386db57842 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.791658 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445d09b-228c-4816-b961-a5386db57842 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.792088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445d09b-228c-4816-b961-a5386db57842 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.793028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445d09b-228c-4816-b961-a5386db57842 None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:15.793490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445d09b-228c-4816-b961-a5386db57842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:15.795102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445d09b-228c-4816-b961-a5386db57842 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:15.813257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 477/950] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:01:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:15.831264 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 474/951] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:15.855824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445d09b-228c-4816-b961-a5386db57842 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:15.914903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:15.970133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445d09b-228c-4816-b961-a5386db57842 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:16.006835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac1edf-c7bc-4724-95de-264aa1d78ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:16.007656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1edf-c7bc-4724-95de-264aa1d78ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:16.007948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1edf-c7bc-4724-95de-264aa1d78ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:16.008230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1edf-c7bc-4724-95de-264aa1d78ec5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:16.008915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac1edf-c7bc-4724-95de-264aa1d78ec5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:16.010313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac1edf-c7bc-4724-95de-264aa1d78ec5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3eac1edf-c7bc-4724-95de-264aa1d78ec5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:16.022780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:16.023850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:16.024753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 478/952] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jun 20 06:01:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:16.030324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674689b-381b-479b-b922-a557d4797489 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:16.051113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:16.147343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674689b-381b-479b-b922-a557d4797489 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:16.183339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeafe90-f26b-466f-93d2-8cd04e08fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:16.184021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeafe90-f26b-466f-93d2-8cd04e08fe05 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:16.184310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeafe90-f26b-466f-93d2-8cd04e08fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:16.184589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeafe90-f26b-466f-93d2-8cd04e08fe05 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:16.185331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeafe90-f26b-466f-93d2-8cd04e08fe05 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:16.185647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeafe90-f26b-466f-93d2-8cd04e08fe05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:16.187026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeafe90-f26b-466f-93d2-8cd04e08fe05 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:16.192562 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 475/953] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jun 20 06:01:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:16.198311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac1edf-c7bc-4724-95de-264aa1d78ec5 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:16.304353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac1edf-c7bc-4724-95de-264aa1d78ec5 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:16.319351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:16.342066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038c5f6-21d3-4cc7-a289-936daef82031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:16.342831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038c5f6-21d3-4cc7-a289-936daef82031 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:16.343190 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038c5f6-21d3-4cc7-a289-936daef82031 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:16.343542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038c5f6-21d3-4cc7-a289-936daef82031 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:16.344335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038c5f6-21d3-4cc7-a289-936daef82031 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:16.344748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038c5f6-21d3-4cc7-a289-936daef82031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:16.346212 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038c5f6-21d3-4cc7-a289-936daef82031 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:16.352157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 479/954] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jun 20 06:01:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:16.358019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeafe90-f26b-466f-93d2-8cd04e08fe05 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:16.445730 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:16.465269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeafe90-f26b-466f-93d2-8cd04e08fe05 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:16.507029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754a1eb-42d5-4d69-b22c-5ed07e43c8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:16.507696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a1eb-42d5-4d69-b22c-5ed07e43c8dc None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:16.507983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a1eb-42d5-4d69-b22c-5ed07e43c8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:16.508262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a1eb-42d5-4d69-b22c-5ed07e43c8dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:16.509043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754a1eb-42d5-4d69-b22c-5ed07e43c8dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:16.510408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754a1eb-42d5-4d69-b22c-5ed07e43c8dc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:16.531125 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 476/955] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jun 20 06:01:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:16.726437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec699d-91d1-4495-8eba-627223a132c3 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:16.726674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec699d-91d1-4495-8eba-627223a132c3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:16.726959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec699d-91d1-4495-8eba-627223a132c3 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:16.728470 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 480/956] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:16.734022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd83f52-6d61-4c00-8893-b86b37607cc2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:16.734311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd83f52-6d61-4c00-8893-b86b37607cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:16.734586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd83f52-6d61-4c00-8893-b86b37607cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:16.757781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5fd83f52-6d61-4c00-8893-b86b37607cc2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:16.758980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5fd83f52-6d61-4c00-8893-b86b37607cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:16.839774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 477/957] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:16.869056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec699d-91d1-4495-8eba-627223a132c3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:17.008312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec699d-91d1-4495-8eba-627223a132c3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:17.057718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94d3b-88b2-4054-aa82-c608a9ea6ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:17.058526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94d3b-88b2-4054-aa82-c608a9ea6ced None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.058862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94d3b-88b2-4054-aa82-c608a9ea6ced None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.059136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94d3b-88b2-4054-aa82-c608a9ea6ced None admin] PATH_INFO: `/v3/services/compute` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.059848 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c94d3b-88b2-4054-aa82-c608a9ea6ced None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:17.061531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c94d3b-88b2-4054-aa82-c608a9ea6ced None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-c6c94d3b-88b2-4054-aa82-c608a9ea6ced None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:17.076154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:17.078663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 06:01:17.080804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:17.084667 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 481/958] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:17.089217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd83f52-6d61-4c00-8893-b86b37607cc2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:17.172556 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:17.231102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd83f52-6d61-4c00-8893-b86b37607cc2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:17.279017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e386d-faf8-4d43-9667-3d5ee459e816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:17.280035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e386d-faf8-4d43-9667-3d5ee459e816 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.280518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e386d-faf8-4d43-9667-3d5ee459e816 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.281369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e386d-faf8-4d43-9667-3d5ee459e816 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.282379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e386d-faf8-4d43-9667-3d5ee459e816 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:17.283278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e386d-faf8-4d43-9667-3d5ee459e816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:17.286251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e386d-faf8-4d43-9667-3d5ee459e816 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:17.298584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 478/959] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:01:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:17.300273 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94d3b-88b2-4054-aa82-c608a9ea6ced None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:17.365979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:17.451878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94d3b-88b2-4054-aa82-c608a9ea6ced None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:17.498722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd992c-882a-4474-af23-e8f1c79f414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:17.499772 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd992c-882a-4474-af23-e8f1c79f414e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.500344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd992c-882a-4474-af23-e8f1c79f414e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.500850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd992c-882a-4474-af23-e8f1c79f414e None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.501880 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd992c-882a-4474-af23-e8f1c79f414e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:17.502388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd992c-882a-4474-af23-e8f1c79f414e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:17.504219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd992c-882a-4474-af23-e8f1c79f414e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:17.516760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 482/960] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:01:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:17.714302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5076b8-5542-4343-b5c7-83ff92849dec None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.715306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5076b8-5542-4343-b5c7-83ff92849dec None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.715884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5076b8-5542-4343-b5c7-83ff92849dec None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.717708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 479/961] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:17.724210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b6e6a-f8bf-4bdc-8b9c-86394e38cf40 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.724522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b6e6a-f8bf-4bdc-8b9c-86394e38cf40 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.724823 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b6e6a-f8bf-4bdc-8b9c-86394e38cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.743794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-fe2b6e6a-f8bf-4bdc-8b9c-86394e38cf40 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:17.745028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fe2b6e6a-f8bf-4bdc-8b9c-86394e38cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:17.819037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 483/962] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:17.842753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5076b8-5542-4343-b5c7-83ff92849dec None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:17.951306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5076b8-5542-4343-b5c7-83ff92849dec None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:17.979592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:17.987724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902f1ba-a929-4e4c-8dd4-2436074d5d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:17.989351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f1ba-a929-4e4c-8dd4-2436074d5d96 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.990039 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f1ba-a929-4e4c-8dd4-2436074d5d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.990390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f1ba-a929-4e4c-8dd4-2436074d5d96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.001299 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902f1ba-a929-4e4c-8dd4-2436074d5d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-0902f1ba-a929-4e4c-8dd4-2436074d5d96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:18.010119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:18.011090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:18.012369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 480/963] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jun 20 06:01:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:18.018200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b6e6a-f8bf-4bdc-8b9c-86394e38cf40 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.052484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4970-01cf-4b16-be31-8f6289480d64 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.052804 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4970-01cf-4b16-be31-8f6289480d64 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.053093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4970-01cf-4b16-be31-8f6289480d64 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.055461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 481/964] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:01:18.058593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.061745 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d347664-c7b8-4a61-83a2-1b2c7e42da86 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.062120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d347664-c7b8-4a61-83a2-1b2c7e42da86 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.062478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d347664-c7b8-4a61-83a2-1b2c7e42da86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.080145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2d347664-c7b8-4a61-83a2-1b2c7e42da86 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:18.081545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2d347664-c7b8-4a61-83a2-1b2c7e42da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:18.130821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b6e6a-f8bf-4bdc-8b9c-86394e38cf40 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.164999 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 482/965] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:18.168945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0713ba4-145e-4bdc-86d6-d96f6e2d5d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.169822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0713ba4-145e-4bdc-86d6-d96f6e2d5d62 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.170267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0713ba4-145e-4bdc-86d6-d96f6e2d5d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.170701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0713ba4-145e-4bdc-86d6-d96f6e2d5d62 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.171602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0713ba4-145e-4bdc-86d6-d96f6e2d5d62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:18.172063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0713ba4-145e-4bdc-86d6-d96f6e2d5d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.173633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0713ba4-145e-4bdc-86d6-d96f6e2d5d62 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.183477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 484/966] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:18.188976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0713ba4-145e-4bdc-86d6-d96f6e2d5d62 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.189102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d347664-c7b8-4a61-83a2-1b2c7e42da86 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.295112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d347664-c7b8-4a61-83a2-1b2c7e42da86 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.296997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0713ba4-145e-4bdc-86d6-d96f6e2d5d62 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.308970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.314435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.333634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235aa64-4104-4884-879c-046832ba7d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.334700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235aa64-4104-4884-879c-046832ba7d0e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.335088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235aa64-4104-4884-879c-046832ba7d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.335470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235aa64-4104-4884-879c-046832ba7d0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.338361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477db91b-7017-4988-9890-ff744ffbbf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.339311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477db91b-7017-4988-9890-ff744ffbbf67 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.339752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477db91b-7017-4988-9890-ff744ffbbf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.340178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477db91b-7017-4988-9890-ff744ffbbf67 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.341105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477db91b-7017-4988-9890-ff744ffbbf67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.342753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477db91b-7017-4988-9890-ff744ffbbf67 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.344354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: WARNING keystone.server.flask.common [None req-477db91b-7017-4988-9890-ff744ffbbf67 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 06:01:18.347635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235aa64-4104-4884-879c-046832ba7d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.349434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235aa64-4104-4884-879c-046832ba7d0e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.358788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.sql.core [None req-477db91b-7017-4988-9890-ff744ffbbf67 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 06:01:18.358788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 06:01:18.358788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [parameters: {'user_id': 'b5402e1bda194f5594408661cbda7424', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 06:01:18.358788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80271) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e235aa64-4104-4884-879c-046832ba7d0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:18.372269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:18.373447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:18.374596 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:18.374596 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:18.374596 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:18.374596 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-477db91b-7017-4988-9890-ff744ffbbf67 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application conn.query(q) Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application result.read() Jun 20 06:01:18.380542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 06:01:18.381465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application next(self.gen) Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application yield resource Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application next(self.gen) Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise self.value Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application session.commit() Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 06:01:18.382452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.session.flush() Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application compat.raise_( Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 06:01:18.383416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 06:01:18.384547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application conn.query(q) Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application result.read() Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 06:01:18.385641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b5402e1bda194f5594408661cbda7424', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:18.386789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 20 06:01:18.387801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 20 06:01:18.389023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 20 06:01:18.389023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 20 06:01:18.389023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 06:01:18.389023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 06:01:18.389023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 06:01:18.389023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:18.389438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 483/967] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:18.389438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235aa64-4104-4884-879c-046832ba7d0e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.391593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 485/968] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jun 20 06:01:18 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:18.397379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477db91b-7017-4988-9890-ff744ffbbf67 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.514406 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477db91b-7017-4988-9890-ff744ffbbf67 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.525701 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235aa64-4104-4884-879c-046832ba7d0e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.552351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fefa7b-8e77-4cdc-8e51-b404b9e92dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.553127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fefa7b-8e77-4cdc-8e51-b404b9e92dae None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.553414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fefa7b-8e77-4cdc-8e51-b404b9e92dae None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.553743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fefa7b-8e77-4cdc-8e51-b404b9e92dae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.565588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fefa7b-8e77-4cdc-8e51-b404b9e92dae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.567688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fefa7b-8e77-4cdc-8e51-b404b9e92dae None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.571505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744c37-fc44-4a39-b085-1aa88345689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.572440 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744c37-fc44-4a39-b085-1aa88345689c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.573048 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744c37-fc44-4a39-b085-1aa88345689c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.573533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34744c37-fc44-4a39-b085-1aa88345689c None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.574805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34744c37-fc44-4a39-b085-1aa88345689c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:18.575325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34744c37-fc44-4a39-b085-1aa88345689c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.576921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34744c37-fc44-4a39-b085-1aa88345689c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-66fefa7b-8e77-4cdc-8e51-b404b9e92dae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:18.583291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:18.584251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:18.585259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:18.585259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:18.585259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:18.585259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:18.585259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:18.585259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:18.585259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:18.585259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:18.585259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 06:01:18.585259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:18.588753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 486/969] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:18.591449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fefa7b-8e77-4cdc-8e51-b404b9e92dae None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.599767 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 484/970] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:18.605786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744c37-fc44-4a39-b085-1aa88345689c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.620748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.655734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.715364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fefa7b-8e77-4cdc-8e51-b404b9e92dae None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.735833 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34744c37-fc44-4a39-b085-1aa88345689c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:18.753565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c9d76-4f6b-407b-a069-51e158e57ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.754456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9d76-4f6b-407b-a069-51e158e57ffd None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.754728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9d76-4f6b-407b-a069-51e158e57ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.755009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9d76-4f6b-407b-a069-51e158e57ffd None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.755822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c9d76-4f6b-407b-a069-51e158e57ffd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:18.756141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c9d76-4f6b-407b-a069-51e158e57ffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.757596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c9d76-4f6b-407b-a069-51e158e57ffd None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.775095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80fc2d-b278-4e86-a082-6a8e71d31acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:18.776244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80fc2d-b278-4e86-a082-6a8e71d31acc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.776772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80fc2d-b278-4e86-a082-6a8e71d31acc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.777261 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80fc2d-b278-4e86-a082-6a8e71d31acc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.786748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80fc2d-b278-4e86-a082-6a8e71d31acc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:18.788433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80fc2d-b278-4e86-a082-6a8e71d31acc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:18.797509 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 487/971] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:18.798967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ddade-2fd5-4dcd-9501-65e2e291b3de None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.799261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ddade-2fd5-4dcd-9501-65e2e291b3de None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.799541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ddade-2fd5-4dcd-9501-65e2e291b3de None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.801762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 488/972] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-3e80fc2d-b278-4e86-a082-6a8e71d31acc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:18.805694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:18.806719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:18.807819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:18.807819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:18.807819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:18.807819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:18.807819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:18.807819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:18.807819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:18.807819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:18.807819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 06:01:18.807819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:18.808411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d28ae1-aab3-44e9-a0a4-8ffaca87fd6e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:18.808411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d28ae1-aab3-44e9-a0a4-8ffaca87fd6e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:18.808411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d28ae1-aab3-44e9-a0a4-8ffaca87fd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:18.810951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 485/973] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:18.817780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80fc2d-b278-4e86-a082-6a8e71d31acc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.826516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-32d28ae1-aab3-44e9-a0a4-8ffaca87fd6e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:18.828237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-32d28ae1-aab3-44e9-a0a4-8ffaca87fd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:18.913043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 489/974] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:18.932068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d28ae1-aab3-44e9-a0a4-8ffaca87fd6e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:18.943824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.947012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:18.961858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80fc2d-b278-4e86-a082-6a8e71d31acc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.010465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1935b1-4bdc-4d6f-8ff2-3cfd553ac1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.011146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1935b1-4bdc-4d6f-8ff2-3cfd553ac1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.011433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1935b1-4bdc-4d6f-8ff2-3cfd553ac1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.011709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1935b1-4bdc-4d6f-8ff2-3cfd553ac1b9 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.012560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1935b1-4bdc-4d6f-8ff2-3cfd553ac1b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:19.012901 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1935b1-4bdc-4d6f-8ff2-3cfd553ac1b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.014338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1935b1-4bdc-4d6f-8ff2-3cfd553ac1b9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.034216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 486/975] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:19.040492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1935b1-4bdc-4d6f-8ff2-3cfd553ac1b9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.078101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d28ae1-aab3-44e9-a0a4-8ffaca87fd6e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.116313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2642e3a-6931-4112-91d1-50315a58fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.117154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2642e3a-6931-4112-91d1-50315a58fe9f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.117439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2642e3a-6931-4112-91d1-50315a58fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.117724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2642e3a-6931-4112-91d1-50315a58fe9f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.118387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2642e3a-6931-4112-91d1-50315a58fe9f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.119773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2642e3a-6931-4112-91d1-50315a58fe9f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-f2642e3a-6931-4112-91d1-50315a58fe9f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:19.132833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:19.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:19.134835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 490/976] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jun 20 06:01:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:19.139897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2642e3a-6931-4112-91d1-50315a58fe9f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.162938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1935b1-4bdc-4d6f-8ff2-3cfd553ac1b9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.201822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f43b26-6241-44ff-b2a0-8b55fc19a20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.202477 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43b26-6241-44ff-b2a0-8b55fc19a20b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.202767 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43b26-6241-44ff-b2a0-8b55fc19a20b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.203045 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43b26-6241-44ff-b2a0-8b55fc19a20b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.217966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:19.222059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:19.256116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2642e3a-6931-4112-91d1-50315a58fe9f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.277814 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f43b26-6241-44ff-b2a0-8b55fc19a20b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.279374 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f43b26-6241-44ff-b2a0-8b55fc19a20b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.292410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758423dc-8b5b-42c7-a236-88cd2c10bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.293123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758423dc-8b5b-42c7-a236-88cd2c10bf88 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.293412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758423dc-8b5b-42c7-a236-88cd2c10bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.293694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758423dc-8b5b-42c7-a236-88cd2c10bf88 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.294408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758423dc-8b5b-42c7-a236-88cd2c10bf88 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:19.294724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758423dc-8b5b-42c7-a236-88cd2c10bf88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.296106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758423dc-8b5b-42c7-a236-88cd2c10bf88 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.301607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 491/977] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:19.306813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758423dc-8b5b-42c7-a236-88cd2c10bf88 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.387873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 487/978] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 06:01:19.393219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f43b26-6241-44ff-b2a0-8b55fc19a20b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.415744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758423dc-8b5b-42c7-a236-88cd2c10bf88 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.444106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:19.451594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2064e5c-a5f7-406a-95d8-a315ce603498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.452257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064e5c-a5f7-406a-95d8-a315ce603498 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.452547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064e5c-a5f7-406a-95d8-a315ce603498 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.452853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064e5c-a5f7-406a-95d8-a315ce603498 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.453568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2064e5c-a5f7-406a-95d8-a315ce603498 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:19.453874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2064e5c-a5f7-406a-95d8-a315ce603498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.455246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2064e5c-a5f7-406a-95d8-a315ce603498 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.457421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:19.466428 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 492/979] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:19.467247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2064e5c-a5f7-406a-95d8-a315ce603498 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.498711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f43b26-6241-44ff-b2a0-8b55fc19a20b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.533639 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c6d16-d94a-444a-a792-66ce0376c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.534692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c6d16-d94a-444a-a792-66ce0376c3de None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.535521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c6d16-d94a-444a-a792-66ce0376c3de None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.535906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c6d16-d94a-444a-a792-66ce0376c3de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.548258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c6d16-d94a-444a-a792-66ce0376c3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.549745 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c6d16-d94a-444a-a792-66ce0376c3de None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-349c6d16-d94a-444a-a792-66ce0376c3de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:19.568739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:19.569828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:19.570867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:19.570867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:19.570867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:19.570867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:19.570867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 488/980] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:19.573922 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2064e5c-a5f7-406a-95d8-a315ce603498 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.575303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c6d16-d94a-444a-a792-66ce0376c3de None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.613311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f661b27-bc84-4381-ac95-29bab25ec1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.614070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f661b27-bc84-4381-ac95-29bab25ec1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.614428 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f661b27-bc84-4381-ac95-29bab25ec1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.614777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f661b27-bc84-4381-ac95-29bab25ec1e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.615660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f661b27-bc84-4381-ac95-29bab25ec1e2 None admin] RBAC: Adding query filter params (interface=admin, service_id=4eb1810c664c4613adfa61d966b6b328, region_id=RegionOne) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:19.616051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f661b27-bc84-4381-ac95-29bab25ec1e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.617984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f661b27-bc84-4381-ac95-29bab25ec1e2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.625635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 493/981] 10.222.0.40 () {56 vars in 1249 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/endpoints?service_id=4eb1810c664c4613adfa61d966b6b328&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:19.630975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f661b27-bc84-4381-ac95-29bab25ec1e2 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.680096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:19.683417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c6d16-d94a-444a-a792-66ce0376c3de None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.702863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:19.720526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bed24-3766-41b1-9e56-bd06f498739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.721265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bed24-3766-41b1-9e56-bd06f498739c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.721557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bed24-3766-41b1-9e56-bd06f498739c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.721838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bed24-3766-41b1-9e56-bd06f498739c None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.723192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bed24-3766-41b1-9e56-bd06f498739c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:19.723508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bed24-3766-41b1-9e56-bd06f498739c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.724996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bed24-3766-41b1-9e56-bd06f498739c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.741065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 489/982] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:19.741065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0f5fb-83f7-4c01-b9ee-f13fe0acd5dd None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.741065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0f5fb-83f7-4c01-b9ee-f13fe0acd5dd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.741065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0f5fb-83f7-4c01-b9ee-f13fe0acd5dd None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.741065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 490/983] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:19.741995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0f5fb-83f7-4c01-b9ee-f13fe0acd5dd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.748818 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f661b27-bc84-4381-ac95-29bab25ec1e2 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.782525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a9b08-f95b-43f3-8ae1-5be95f42996a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.783182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a9b08-f95b-43f3-8ae1-5be95f42996a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.783467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a9b08-f95b-43f3-8ae1-5be95f42996a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.783744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a9b08-f95b-43f3-8ae1-5be95f42996a None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.784718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a9b08-f95b-43f3-8ae1-5be95f42996a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.786761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a9b08-f95b-43f3-8ae1-5be95f42996a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.792993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 494/984] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:01:19.794228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df8321-851e-47b0-a264-004523572b7c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.794519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df8321-851e-47b0-a264-004523572b7c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.794793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df8321-851e-47b0-a264-004523572b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.818362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-27df8321-851e-47b0-a264-004523572b7c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:19.819600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-27df8321-851e-47b0-a264-004523572b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:19.851169 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0f5fb-83f7-4c01-b9ee-f13fe0acd5dd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.888416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fa08b-b8b3-4fc7-8e08-3129e3d4499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.889274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fa08b-b8b3-4fc7-8e08-3129e3d4499f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.889566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fa08b-b8b3-4fc7-8e08-3129e3d4499f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.889847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fa08b-b8b3-4fc7-8e08-3129e3d4499f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.898554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fa08b-b8b3-4fc7-8e08-3129e3d4499f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.900038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fa08b-b8b3-4fc7-8e08-3129e3d4499f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.900978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 495/985] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-865fa08b-b8b3-4fc7-8e08-3129e3d4499f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:19.920190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:19.921229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:19.922138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:19.922138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:19.922138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:19.922138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:19.922138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:19.922138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:19.922138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:19.922138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:19.924958 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 491/986] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:19.925284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df8321-851e-47b0-a264-004523572b7c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.927391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fa08b-b8b3-4fc7-8e08-3129e3d4499f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.950797 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:19.994943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:20.039864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fa08b-b8b3-4fc7-8e08-3129e3d4499f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:20.040561 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df8321-851e-47b0-a264-004523572b7c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:20.078246 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0bee9-ecd1-4dca-ad02-78a85b1056e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:20.078698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfba34e-15ab-4435-9fac-f2b3f7f5cc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:20.078916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0bee9-ecd1-4dca-ad02-78a85b1056e3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:20.079204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0bee9-ecd1-4dca-ad02-78a85b1056e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:20.079366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfba34e-15ab-4435-9fac-f2b3f7f5cc97 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:20.079463 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0bee9-ecd1-4dca-ad02-78a85b1056e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:20.079653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfba34e-15ab-4435-9fac-f2b3f7f5cc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:20.079935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfba34e-15ab-4435-9fac-f2b3f7f5cc97 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:20.080263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0bee9-ecd1-4dca-ad02-78a85b1056e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:20.080577 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0bee9-ecd1-4dca-ad02-78a85b1056e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:20.080707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfba34e-15ab-4435-9fac-f2b3f7f5cc97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:20.082620 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfba34e-15ab-4435-9fac-f2b3f7f5cc97 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:20.082823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0bee9-ecd1-4dca-ad02-78a85b1056e3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:20.095956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 492/987] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:20.101465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0bee9-ecd1-4dca-ad02-78a85b1056e3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:20.102227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 496/988] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 06:01:19 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:01:20.194206 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:20.215748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0bee9-ecd1-4dca-ad02-78a85b1056e3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:20.259802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae8cbb-3825-45a8-ac29-9c8c7e379092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:20.260469 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae8cbb-3825-45a8-ac29-9c8c7e379092 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:20.260780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae8cbb-3825-45a8-ac29-9c8c7e379092 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:20.261053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae8cbb-3825-45a8-ac29-9c8c7e379092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:20.261880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae8cbb-3825-45a8-ac29-9c8c7e379092 None admin] RBAC: Adding query filter params (role.id=aabc773ecbd1409e8482cff30512ac1e, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=6c8e272684d542caaaecce191467edc6) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:20.262195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae8cbb-3825-45a8-ac29-9c8c7e379092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:20.263625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae8cbb-3825-45a8-ac29-9c8c7e379092 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:20.270035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 493/989] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:20 2022] GET /identity/v3/role_assignments?user.id=6c8e272684d542caaaecce191467edc6&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=aabc773ecbd1409e8482cff30512ac1e => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:21.850459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15016-3853-4c35-9ea0-b4d2bf8aef03 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:21.850981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15016-3853-4c35-9ea0-b4d2bf8aef03 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:21.851061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15016-3853-4c35-9ea0-b4d2bf8aef03 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:21.852556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 497/990] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:21.857565 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb8fbf-708c-4e49-8ab2-22748348c229 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:21.857957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb8fbf-708c-4e49-8ab2-22748348c229 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:21.858135 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb8fbf-708c-4e49-8ab2-22748348c229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:21.875418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-52fb8fbf-708c-4e49-8ab2-22748348c229 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:21.876678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-52fb8fbf-708c-4e49-8ab2-22748348c229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:21.947770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 494/991] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:21.967650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c15016-3853-4c35-9ea0-b4d2bf8aef03 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.071923 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c15016-3853-4c35-9ea0-b4d2bf8aef03 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.089842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:22.108123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac11c7-ef57-48e2-8947-2c997554abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.108970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac11c7-ef57-48e2-8947-2c997554abbc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.109258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac11c7-ef57-48e2-8947-2c997554abbc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.109549 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac11c7-ef57-48e2-8947-2c997554abbc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.110211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac11c7-ef57-48e2-8947-2c997554abbc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.111604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac11c7-ef57-48e2-8947-2c997554abbc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-b7ac11c7-ef57-48e2-8947-2c997554abbc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:22.124265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:22.125460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:22.131967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 498/992] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jun 20 06:01:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:22.134488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb8fbf-708c-4e49-8ab2-22748348c229 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.207059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:22.217948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd70ea-492f-4da5-ab0c-6a985618a9e8 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.218407 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd70ea-492f-4da5-ab0c-6a985618a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.218701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd70ea-492f-4da5-ab0c-6a985618a9e8 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.220095 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 499/993] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:01:22.226175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12f00-e30f-48f5-9d15-d13d8080f98b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.226466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12f00-e30f-48f5-9d15-d13d8080f98b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.226748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12f00-e30f-48f5-9d15-d13d8080f98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.244213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c2c12f00-e30f-48f5-9d15-d13d8080f98b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:22.244979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb8fbf-708c-4e49-8ab2-22748348c229 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.245428 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c2c12f00-e30f-48f5-9d15-d13d8080f98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:22.282010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f1b9-704c-4992-944a-de72dc08bdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.282682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f1b9-704c-4992-944a-de72dc08bdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.282970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f1b9-704c-4992-944a-de72dc08bdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.283248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f1b9-704c-4992-944a-de72dc08bdf4 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.283958 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f1b9-704c-4992-944a-de72dc08bdf4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:22.284268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f1b9-704c-4992-944a-de72dc08bdf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.286644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f1b9-704c-4992-944a-de72dc08bdf4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.292298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 495/994] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:22.297582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f1b9-704c-4992-944a-de72dc08bdf4 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.322654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 500/995] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:22.324668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5705f-26f4-4961-a725-077ea43f4394 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.324962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5705f-26f4-4961-a725-077ea43f4394 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.325241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5705f-26f4-4961-a725-077ea43f4394 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.326633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 501/996] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:01:22.331378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e8ee6-6f71-4bed-9194-0162266fb338 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.331668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e8ee6-6f71-4bed-9194-0162266fb338 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.332534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e8ee6-6f71-4bed-9194-0162266fb338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.349616 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-383e8ee6-6f71-4bed-9194-0162266fb338 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:22.350794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-383e8ee6-6f71-4bed-9194-0162266fb338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:22.403660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f1b9-704c-4992-944a-de72dc08bdf4 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.419148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 502/997] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:22.419968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e8ee6-6f71-4bed-9194-0162266fb338 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.440892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63acfc-0996-4949-8ac3-077f4c541a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.442185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63acfc-0996-4949-8ac3-077f4c541a28 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.442469 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63acfc-0996-4949-8ac3-077f4c541a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.442751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63acfc-0996-4949-8ac3-077f4c541a28 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.443460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63acfc-0996-4949-8ac3-077f4c541a28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:22.443766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63acfc-0996-4949-8ac3-077f4c541a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.445161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63acfc-0996-4949-8ac3-077f4c541a28 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.446538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:22.455995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 496/998] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:22.455995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63acfc-0996-4949-8ac3-077f4c541a28 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.466406 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:22.523516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e8ee6-6f71-4bed-9194-0162266fb338 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.549534 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63acfc-0996-4949-8ac3-077f4c541a28 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.557764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b48d67-817d-4bb5-be22-3d9c5d82c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.558564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b48d67-817d-4bb5-be22-3d9c5d82c858 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.558855 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b48d67-817d-4bb5-be22-3d9c5d82c858 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.559142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b48d67-817d-4bb5-be22-3d9c5d82c858 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.559797 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b48d67-817d-4bb5-be22-3d9c5d82c858 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.561224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b48d67-817d-4bb5-be22-3d9c5d82c858 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-c4b48d67-817d-4bb5-be22-3d9c5d82c858 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:22.573959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:22.575105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:22.576398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 503/999] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:22.577303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b48d67-817d-4bb5-be22-3d9c5d82c858 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.586928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4691-5333-432d-81da-7796ab504351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.587720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4691-5333-432d-81da-7796ab504351 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.588005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4691-5333-432d-81da-7796ab504351 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.588289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4691-5333-432d-81da-7796ab504351 None admin] PATH_INFO: `/v3/services/image` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.588981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b4691-5333-432d-81da-7796ab504351 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.590349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b4691-5333-432d-81da-7796ab504351 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-af4b4691-5333-432d-81da-7796ab504351 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:22.601870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:22.603038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:22.603934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 497/1000] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:22.604902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4691-5333-432d-81da-7796ab504351 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.669128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:22.680055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b48d67-817d-4bb5-be22-3d9c5d82c858 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.686919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:22.708965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4691-5333-432d-81da-7796ab504351 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.714851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc061706-96db-4362-8c92-2fcf75847f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.715518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc061706-96db-4362-8c92-2fcf75847f65 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.715807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc061706-96db-4362-8c92-2fcf75847f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.716086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc061706-96db-4362-8c92-2fcf75847f65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.716855 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc061706-96db-4362-8c92-2fcf75847f65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.718237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc061706-96db-4362-8c92-2fcf75847f65 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.733203 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 504/1001] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jun 20 06:01:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:22.733993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc061706-96db-4362-8c92-2fcf75847f65 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.752339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05689316-5c57-4d1b-87bf-1a080337bc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.754599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05689316-5c57-4d1b-87bf-1a080337bc3a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.755349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05689316-5c57-4d1b-87bf-1a080337bc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.755849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05689316-5c57-4d1b-87bf-1a080337bc3a None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.756994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05689316-5c57-4d1b-87bf-1a080337bc3a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:22.757894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05689316-5c57-4d1b-87bf-1a080337bc3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.759549 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05689316-5c57-4d1b-87bf-1a080337bc3a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.766995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 498/1002] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:22.773194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05689316-5c57-4d1b-87bf-1a080337bc3a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.859079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc061706-96db-4362-8c92-2fcf75847f65 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.885719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05689316-5c57-4d1b-87bf-1a080337bc3a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:22.905441 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc182f9-9ba2-48a3-b610-da28ae39ed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.906090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc182f9-9ba2-48a3-b610-da28ae39ed9a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.906378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc182f9-9ba2-48a3-b610-da28ae39ed9a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.906652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc182f9-9ba2-48a3-b610-da28ae39ed9a None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.907377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc182f9-9ba2-48a3-b610-da28ae39ed9a None admin] RBAC: Adding query filter params (name=image) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:22.907662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc182f9-9ba2-48a3-b610-da28ae39ed9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.909084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc182f9-9ba2-48a3-b610-da28ae39ed9a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.911473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:22.916288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 505/1003] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:22.922092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc182f9-9ba2-48a3-b610-da28ae39ed9a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.925411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf9522-3e8b-4528-a6b6-a130128050ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:22.926601 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf9522-3e8b-4528-a6b6-a130128050ab None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:22.926890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf9522-3e8b-4528-a6b6-a130128050ab None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:22.927175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf9522-3e8b-4528-a6b6-a130128050ab None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:22.927893 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf9522-3e8b-4528-a6b6-a130128050ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:22.928203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf9522-3e8b-4528-a6b6-a130128050ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:22.929683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf9522-3e8b-4528-a6b6-a130128050ab None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:22.934918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 499/1004] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:22.940808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf9522-3e8b-4528-a6b6-a130128050ab None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:22.955281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:23.030866 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc182f9-9ba2-48a3-b610-da28ae39ed9a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.050220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf9522-3e8b-4528-a6b6-a130128050ab None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.070449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72758e1f-9133-459b-a663-e8300ae91b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.071405 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72758e1f-9133-459b-a663-e8300ae91b35 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.071868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72758e1f-9133-459b-a663-e8300ae91b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.072344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72758e1f-9133-459b-a663-e8300ae91b35 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.073279 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72758e1f-9133-459b-a663-e8300ae91b35 None admin] RBAC: Adding query filter params (type=image) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:23.073764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72758e1f-9133-459b-a663-e8300ae91b35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.075320 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72758e1f-9133-459b-a663-e8300ae91b35 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.079982 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 506/1005] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:23.088495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f144a-3bd3-4c99-b88a-129351f3d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.089307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f144a-3bd3-4c99-b88a-129351f3d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.089595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f144a-3bd3-4c99-b88a-129351f3d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.089876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f144a-3bd3-4c99-b88a-129351f3d4b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.090696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f144a-3bd3-4c99-b88a-129351f3d4b7 None admin] RBAC: Adding query filter params (interface=public, service_id=835a72559ae04c548523029d73ed7808, region_id=RegionOne) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:23.091017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f144a-3bd3-4c99-b88a-129351f3d4b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.092453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f144a-3bd3-4c99-b88a-129351f3d4b7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.100652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 500/1006] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jun 20 06:01:22 2022] GET /identity/v3/endpoints?service_id=835a72559ae04c548523029d73ed7808&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:23.104918 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72758e1f-9133-459b-a663-e8300ae91b35 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:23.211150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:23.219589 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72758e1f-9133-459b-a663-e8300ae91b35 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:23.259310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a023d2b-2bd6-4268-8512-d909a5dec913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:23.260022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a023d2b-2bd6-4268-8512-d909a5dec913 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:23.260311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a023d2b-2bd6-4268-8512-d909a5dec913 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:23.260627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a023d2b-2bd6-4268-8512-d909a5dec913 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:23.261326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a023d2b-2bd6-4268-8512-d909a5dec913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:23.262704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a023d2b-2bd6-4268-8512-d909a5dec913 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:23.270115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 507/1007] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jun 20 06:01:23 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:01:24.818707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6cb9-50fd-4571-8e2f-75cbd7e12b7c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:24.819284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6cb9-50fd-4571-8e2f-75cbd7e12b7c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:24.819284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6cb9-50fd-4571-8e2f-75cbd7e12b7c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:24.820822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 501/1008] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:24.826040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ecfe-b428-4029-80de-4e4b1c2bcb7e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:24.826483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ecfe-b428-4029-80de-4e4b1c2bcb7e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:24.826681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ecfe-b428-4029-80de-4e4b1c2bcb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:24.844041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e9a6ecfe-b428-4029-80de-4e4b1c2bcb7e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:24.845261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e9a6ecfe-b428-4029-80de-4e4b1c2bcb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:24.917506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 508/1009] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:24.940600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d6cb9-50fd-4571-8e2f-75cbd7e12b7c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:24.993577 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:25.047223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d6cb9-50fd-4571-8e2f-75cbd7e12b7c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:25.082228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3e59b-62d4-44a4-b6bf-6e3801da9ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:25.083027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3e59b-62d4-44a4-b6bf-6e3801da9ada None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.083314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3e59b-62d4-44a4-b6bf-6e3801da9ada None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.083591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3e59b-62d4-44a4-b6bf-6e3801da9ada None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.084811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3e59b-62d4-44a4-b6bf-6e3801da9ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:25.086252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3e59b-62d4-44a4-b6bf-6e3801da9ada None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:25.088036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 502/1010] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:25.093594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ecfe-b428-4029-80de-4e4b1c2bcb7e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:25.172957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a930dbd-6b97-448b-ab7d-bfcf0d986186 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.173258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a930dbd-6b97-448b-ab7d-bfcf0d986186 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.173457 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a930dbd-6b97-448b-ab7d-bfcf0d986186 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.175011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 503/1011] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:25.180688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2d93e-379f-4543-abca-3f5b819606e9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.180988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2d93e-379f-4543-abca-3f5b819606e9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.181275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2d93e-379f-4543-abca-3f5b819606e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.193200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:25.200257 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-00f2d93e-379f-4543-abca-3f5b819606e9 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:25.201547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-00f2d93e-379f-4543-abca-3f5b819606e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:25.210586 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ecfe-b428-4029-80de-4e4b1c2bcb7e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:25.259897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9f520-45ba-4a58-969d-362c6936d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:25.260566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9f520-45ba-4a58-969d-362c6936d89e None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.260884 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9f520-45ba-4a58-969d-362c6936d89e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.261165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9f520-45ba-4a58-969d-362c6936d89e None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.261895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9f520-45ba-4a58-969d-362c6936d89e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:25.263343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9f520-45ba-4a58-969d-362c6936d89e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:25.282441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 504/1012] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:25.292734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 509/1013] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 06:01:25 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:25.308661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2d93e-379f-4543-abca-3f5b819606e9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:25.321754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb1eb7-605a-435e-8040-c61f5fd2ff38 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.322108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb1eb7-605a-435e-8040-c61f5fd2ff38 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.322324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb1eb7-605a-435e-8040-c61f5fd2ff38 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.323899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 510/1014] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:01:25.329624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddb749-ce5a-4254-b709-52f9a5e383e3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.330027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddb749-ce5a-4254-b709-52f9a5e383e3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.330245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddb749-ce5a-4254-b709-52f9a5e383e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.348372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e3ddb749-ce5a-4254-b709-52f9a5e383e3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:25.349653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e3ddb749-ce5a-4254-b709-52f9a5e383e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:25.371702 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:25.436736 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 511/1015] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:25.436916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2d93e-379f-4543-abca-3f5b819606e9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:25.456466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddb749-ce5a-4254-b709-52f9a5e383e3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:25.475438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c150dc-4c66-4735-ab15-4c149dc41d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:25.476171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c150dc-4c66-4735-ab15-4c149dc41d40 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.476390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c150dc-4c66-4735-ab15-4c149dc41d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.476709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c150dc-4c66-4735-ab15-4c149dc41d40 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.477434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c150dc-4c66-4735-ab15-4c149dc41d40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:25.479650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c150dc-4c66-4735-ab15-4c149dc41d40 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:25.495399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 505/1016] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 06:01:25 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:25.539762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:25.581384 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddb749-ce5a-4254-b709-52f9a5e383e3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:25.630914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb30a7-401d-43d7-bba4-d049c9db2532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:25.632182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb30a7-401d-43d7-bba4-d049c9db2532 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.632727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb30a7-401d-43d7-bba4-d049c9db2532 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.633270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb30a7-401d-43d7-bba4-d049c9db2532 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.634160 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb30a7-401d-43d7-bba4-d049c9db2532 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:25.636436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb30a7-401d-43d7-bba4-d049c9db2532 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-46cb30a7-401d-43d7-bba4-d049c9db2532 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:25.649468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:25.650711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:25.651571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 512/1017] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:25.656895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c150dc-4c66-4735-ab15-4c149dc41d40 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:25.765643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c150dc-4c66-4735-ab15-4c149dc41d40 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:25.774915 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:25.803746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac92ef0-1f9f-4ec3-9eb1-824dc5cb00f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:25.804415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac92ef0-1f9f-4ec3-9eb1-824dc5cb00f2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.804724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac92ef0-1f9f-4ec3-9eb1-824dc5cb00f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.805001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac92ef0-1f9f-4ec3-9eb1-824dc5cb00f2 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.805709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac92ef0-1f9f-4ec3-9eb1-824dc5cb00f2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:25.806014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac92ef0-1f9f-4ec3-9eb1-824dc5cb00f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:25.807380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac92ef0-1f9f-4ec3-9eb1-824dc5cb00f2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:25.812567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 506/1018] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:01:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:25.818750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb30a7-401d-43d7-bba4-d049c9db2532 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:25.926391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb30a7-401d-43d7-bba4-d049c9db2532 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:25.955334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:25.962693 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef78b0-0fc8-4bb1-a724-b956f1ab681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:25.963370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef78b0-0fc8-4bb1-a724-b956f1ab681b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:25.963660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef78b0-0fc8-4bb1-a724-b956f1ab681b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:25.963942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef78b0-0fc8-4bb1-a724-b956f1ab681b None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:25.964744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef78b0-0fc8-4bb1-a724-b956f1ab681b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:25.965068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef78b0-0fc8-4bb1-a724-b956f1ab681b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:25.966453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef78b0-0fc8-4bb1-a724-b956f1ab681b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:25.976146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 513/1019] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jun 20 06:01:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:25.977128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac92ef0-1f9f-4ec3-9eb1-824dc5cb00f2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:26.079283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac92ef0-1f9f-4ec3-9eb1-824dc5cb00f2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:26.113495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa41830-daf0-4fb9-85ca-b5a7a6d1e5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:26.114011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa41830-daf0-4fb9-85ca-b5a7a6d1e5bf None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:26.114298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa41830-daf0-4fb9-85ca-b5a7a6d1e5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:26.114575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa41830-daf0-4fb9-85ca-b5a7a6d1e5bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:26.115323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa41830-daf0-4fb9-85ca-b5a7a6d1e5bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:26.116724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa41830-daf0-4fb9-85ca-b5a7a6d1e5bf None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:26.140651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 507/1020] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jun 20 06:01:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:01:27.433301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f76d-5911-4b85-8bcc-221366c95f00 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.433824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f76d-5911-4b85-8bcc-221366c95f00 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.433902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f76d-5911-4b85-8bcc-221366c95f00 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.435396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 514/1021] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:27.440421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1113f-cbb4-47ba-be49-051286643b28 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.440838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1113f-cbb4-47ba-be49-051286643b28 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.441112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1113f-cbb4-47ba-be49-051286643b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.458592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-44a1113f-cbb4-47ba-be49-051286643b28 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:27.459782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-44a1113f-cbb4-47ba-be49-051286643b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:27.483079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:27.540646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 508/1022] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:27.561256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8f76d-5911-4b85-8bcc-221366c95f00 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:27.585197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e0e9-9aef-4c76-bcc1-055609427038 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.585494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e0e9-9aef-4c76-bcc1-055609427038 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.585777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e0e9-9aef-4c76-bcc1-055609427038 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.587381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 509/1023] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:01:27.592008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17e78c-d52f-4998-8553-f73246a2d4df None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.592302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17e78c-d52f-4998-8553-f73246a2d4df None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.592586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17e78c-d52f-4998-8553-f73246a2d4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.610007 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-df17e78c-d52f-4998-8553-f73246a2d4df None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:27.611313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-df17e78c-d52f-4998-8553-f73246a2d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:27.676831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8f76d-5911-4b85-8bcc-221366c95f00 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:27.689000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 510/1024] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:27.710898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17e78c-d52f-4998-8553-f73246a2d4df None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:27.713980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e6740-77e8-4e24-96e6-7d0724a9506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:27.714760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6740-77e8-4e24-96e6-7d0724a9506d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.715050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6740-77e8-4e24-96e6-7d0724a9506d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.715329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6740-77e8-4e24-96e6-7d0724a9506d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.716520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e6740-77e8-4e24-96e6-7d0724a9506d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:27.718031 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e6740-77e8-4e24-96e6-7d0724a9506d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:27.719974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 515/1025] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:27.725486 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e6740-77e8-4e24-96e6-7d0724a9506d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:27.790469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:27.808321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:27.828300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17e78c-d52f-4998-8553-f73246a2d4df None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:27.840717 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e6740-77e8-4e24-96e6-7d0724a9506d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:27.867989 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79a5fa-c191-483e-bb3b-9dbb5794c3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:27.869154 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79a5fa-c191-483e-bb3b-9dbb5794c3fa None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.869441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79a5fa-c191-483e-bb3b-9dbb5794c3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.869721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79a5fa-c191-483e-bb3b-9dbb5794c3fa None admin] PATH_INFO: `/v3/services/image` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.870377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79a5fa-c191-483e-bb3b-9dbb5794c3fa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:27.871755 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79a5fa-c191-483e-bb3b-9dbb5794c3fa None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:27.879411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444df03-4658-403d-87f7-133803de4bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:27.880142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444df03-4658-403d-87f7-133803de4bfa None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:27.880453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444df03-4658-403d-87f7-133803de4bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:27.880763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444df03-4658-403d-87f7-133803de4bfa None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:27.881478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444df03-4658-403d-87f7-133803de4bfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:27.882890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444df03-4658-403d-87f7-133803de4bfa None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-9e79a5fa-c191-483e-bb3b-9dbb5794c3fa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:27.884302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:27.885461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 06:01:27.886326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:27.891025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 511/1026] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Jun 20 06:01:27 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:27.891213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79a5fa-c191-483e-bb3b-9dbb5794c3fa None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:27.912828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 516/1027] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 06:01:27 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:01:28.005602 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79a5fa-c191-483e-bb3b-9dbb5794c3fa None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.041831 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbbfc9-1374-4edc-98e8-eef5d454316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.042524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbbfc9-1374-4edc-98e8-eef5d454316f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.042815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbbfc9-1374-4edc-98e8-eef5d454316f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.043099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbbfc9-1374-4edc-98e8-eef5d454316f None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.043893 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbbfc9-1374-4edc-98e8-eef5d454316f None admin] RBAC: Adding query filter params (name=image) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:28.044214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbbfc9-1374-4edc-98e8-eef5d454316f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.045656 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbbfc9-1374-4edc-98e8-eef5d454316f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.056452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 512/1028] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:28.058091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444df03-4658-403d-87f7-133803de4bfa None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.168167 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444df03-4658-403d-87f7-133803de4bfa None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.187042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:28.206439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbb9d9-1d66-4415-be1b-48d1654d5a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.207514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbb9d9-1d66-4415-be1b-48d1654d5a32 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.208001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbb9d9-1d66-4415-be1b-48d1654d5a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.208481 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbb9d9-1d66-4415-be1b-48d1654d5a32 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.209409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbb9d9-1d66-4415-be1b-48d1654d5a32 None admin] RBAC: Adding query filter params (type=image) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:28.209929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbb9d9-1d66-4415-be1b-48d1654d5a32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.211500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbb9d9-1d66-4415-be1b-48d1654d5a32 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.217316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 517/1029] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:28.223573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbbfc9-1374-4edc-98e8-eef5d454316f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.239958 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:28.319955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff1b8d-4819-42e1-ae0b-8d4ccef9df07 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.320155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff1b8d-4819-42e1-ae0b-8d4ccef9df07 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.320424 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff1b8d-4819-42e1-ae0b-8d4ccef9df07 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.322086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 518/1030] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:01:28.326975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2879e2-eec6-443e-beee-993a4bd7a1a9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.327264 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2879e2-eec6-443e-beee-993a4bd7a1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.327542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2879e2-eec6-443e-beee-993a4bd7a1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.335398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbbfc9-1374-4edc-98e8-eef5d454316f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.345409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0a2879e2-eec6-443e-beee-993a4bd7a1a9 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:28.346585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0a2879e2-eec6-443e-beee-993a4bd7a1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:28.375088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc011058-842b-42bc-8ca6-d8e9a8c92158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.375748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc011058-842b-42bc-8ca6-d8e9a8c92158 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.376030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc011058-842b-42bc-8ca6-d8e9a8c92158 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.376303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc011058-842b-42bc-8ca6-d8e9a8c92158 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.377118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc011058-842b-42bc-8ca6-d8e9a8c92158 None admin] RBAC: Adding query filter params (interface=public, service_id=dd8d7ed7c1644d6bb021c2d7975fc47a, region_id=RegionOne) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:28.377432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc011058-842b-42bc-8ca6-d8e9a8c92158 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.379927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc011058-842b-42bc-8ca6-d8e9a8c92158 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.389675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 513/1031] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/endpoints?service_id=dd8d7ed7c1644d6bb021c2d7975fc47a&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:28.391374 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc011058-842b-42bc-8ca6-d8e9a8c92158 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.432940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 519/1032] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:28.453179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2879e2-eec6-443e-beee-993a4bd7a1a9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.475715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:28.499934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc011058-842b-42bc-8ca6-d8e9a8c92158 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.538327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe1aad-7769-48e7-9b34-b4090e733429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.539280 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe1aad-7769-48e7-9b34-b4090e733429 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.539563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe1aad-7769-48e7-9b34-b4090e733429 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.539840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe1aad-7769-48e7-9b34-b4090e733429 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.540519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe1aad-7769-48e7-9b34-b4090e733429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.541971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe1aad-7769-48e7-9b34-b4090e733429 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.556641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 514/1033] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:01:28.576680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2879e2-eec6-443e-beee-993a4bd7a1a9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.592763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:28.626167 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa7a70-6825-4372-b7e7-36d4c20880bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.627316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa7a70-6825-4372-b7e7-36d4c20880bb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.627824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa7a70-6825-4372-b7e7-36d4c20880bb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.630038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa7a70-6825-4372-b7e7-36d4c20880bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.643432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa7a70-6825-4372-b7e7-36d4c20880bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-b1aa7a70-6825-4372-b7e7-36d4c20880bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:28.652308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:28.653566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:28.659690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 520/1034] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:28.661180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe1aad-7769-48e7-9b34-b4090e733429 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.770173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe1aad-7769-48e7-9b34-b4090e733429 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.804810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589654d-fa68-4d7c-88cb-ac24eeb0be75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.805482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589654d-fa68-4d7c-88cb-ac24eeb0be75 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.805771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589654d-fa68-4d7c-88cb-ac24eeb0be75 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.806050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589654d-fa68-4d7c-88cb-ac24eeb0be75 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.806790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589654d-fa68-4d7c-88cb-ac24eeb0be75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:28.807103 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589654d-fa68-4d7c-88cb-ac24eeb0be75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.808466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589654d-fa68-4d7c-88cb-ac24eeb0be75 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.817422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 515/1035] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:28.822945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa7a70-6825-4372-b7e7-36d4c20880bb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.930302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa7a70-6825-4372-b7e7-36d4c20880bb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.966659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74ee0c-7aaf-49cc-97db-c6a065709a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.967450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ee0c-7aaf-49cc-97db-c6a065709a7d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.967730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ee0c-7aaf-49cc-97db-c6a065709a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.968004 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ee0c-7aaf-49cc-97db-c6a065709a7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.979244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74ee0c-7aaf-49cc-97db-c6a065709a7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.980786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74ee0c-7aaf-49cc-97db-c6a065709a7d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-bd74ee0c-7aaf-49cc-97db-c6a065709a7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:28.998078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:28.999030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:28.999961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:28.999961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:28.999961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:28.999961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:29.004449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 521/1036] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:29.005675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589654d-fa68-4d7c-88cb-ac24eeb0be75 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:29.008636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:29.114229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589654d-fa68-4d7c-88cb-ac24eeb0be75 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:29.148468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff802a57-c209-4032-8103-e4443e03df6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:29.149163 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802a57-c209-4032-8103-e4443e03df6a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.149458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802a57-c209-4032-8103-e4443e03df6a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.149739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802a57-c209-4032-8103-e4443e03df6a None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.150463 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff802a57-c209-4032-8103-e4443e03df6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:29.150777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff802a57-c209-4032-8103-e4443e03df6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:29.152158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff802a57-c209-4032-8103-e4443e03df6a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:29.164872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 516/1037] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:29.170189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74ee0c-7aaf-49cc-97db-c6a065709a7d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:29.198994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:29.279513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74ee0c-7aaf-49cc-97db-c6a065709a7d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:29.314678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a305a3-1ff9-4404-a091-86f9852a459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:29.315472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a305a3-1ff9-4404-a091-86f9852a459f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.315757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a305a3-1ff9-4404-a091-86f9852a459f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.316697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a305a3-1ff9-4404-a091-86f9852a459f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.324519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a305a3-1ff9-4404-a091-86f9852a459f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:29.326028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a305a3-1ff9-4404-a091-86f9852a459f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-a5a305a3-1ff9-4404-a091-86f9852a459f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:29.340305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:29.341469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:29.343038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:29.343038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:29.343038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:29.343038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:29.343038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:29.343038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:29.343038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:29.343038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:29.343038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:01:29.343038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:29.343038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 522/1038] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jun 20 06:01:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:29.347080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff802a57-c209-4032-8103-e4443e03df6a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:29.411306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:29.451182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff802a57-c209-4032-8103-e4443e03df6a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:29.486016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570f71b-e11f-47bd-9e32-f51c2f1b2e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:29.486746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570f71b-e11f-47bd-9e32-f51c2f1b2e8c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.486966 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570f71b-e11f-47bd-9e32-f51c2f1b2e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.487242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570f71b-e11f-47bd-9e32-f51c2f1b2e8c None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.488142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570f71b-e11f-47bd-9e32-f51c2f1b2e8c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:29.488453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570f71b-e11f-47bd-9e32-f51c2f1b2e8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:29.490068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570f71b-e11f-47bd-9e32-f51c2f1b2e8c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:29.511483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 517/1039] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jun 20 06:01:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:29.512738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a305a3-1ff9-4404-a091-86f9852a459f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:29.598149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:29.615375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a305a3-1ff9-4404-a091-86f9852a459f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:29.660214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcb7cf-6918-4af3-a112-1be83f030f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:29.660896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcb7cf-6918-4af3-a112-1be83f030f2a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.661183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcb7cf-6918-4af3-a112-1be83f030f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.661464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcb7cf-6918-4af3-a112-1be83f030f2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.740536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcb7cf-6918-4af3-a112-1be83f030f2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:29.742019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcb7cf-6918-4af3-a112-1be83f030f2a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:29.824973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:29.846671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 523/1040] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:29 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 06:01:29.848389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570f71b-e11f-47bd-9e32-f51c2f1b2e8c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:29.947998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570f71b-e11f-47bd-9e32-f51c2f1b2e8c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:29.967771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:29.983522 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd853d-5745-4846-bddd-0b5cc86e9c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:29.984310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd853d-5745-4846-bddd-0b5cc86e9c8b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:29.984600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd853d-5745-4846-bddd-0b5cc86e9c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:29.984914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd853d-5745-4846-bddd-0b5cc86e9c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:29.995944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd853d-5745-4846-bddd-0b5cc86e9c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:29.997427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd853d-5745-4846-bddd-0b5cc86e9c8b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-a6fd853d-5745-4846-bddd-0b5cc86e9c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:30.014860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:30.015781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:30.021505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:30.021505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:30.021505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:30.021505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:30.021505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 518/1041] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:30.021790 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcb7cf-6918-4af3-a112-1be83f030f2a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.033091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b0585-ad39-48d0-9ae7-f7b2a1cfce56 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.033379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b0585-ad39-48d0-9ae7-f7b2a1cfce56 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.033661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b0585-ad39-48d0-9ae7-f7b2a1cfce56 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.036317 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 519/1042] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:01:30.041099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b97a43-d80e-44cb-b195-62b0b70f5669 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.041384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b97a43-d80e-44cb-b195-62b0b70f5669 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.041667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b97a43-d80e-44cb-b195-62b0b70f5669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.059583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a6b97a43-d80e-44cb-b195-62b0b70f5669 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:30.060778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a6b97a43-d80e-44cb-b195-62b0b70f5669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:30.123869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcb7cf-6918-4af3-a112-1be83f030f2a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.134920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 520/1043] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:30.158583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820fe39-ee25-4227-8db7-eb69f2ccee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.159336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fe39-ee25-4227-8db7-eb69f2ccee48 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.160544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fe39-ee25-4227-8db7-eb69f2ccee48 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.160942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fe39-ee25-4227-8db7-eb69f2ccee48 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.161629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b97a43-d80e-44cb-b195-62b0b70f5669 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.161923 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820fe39-ee25-4227-8db7-eb69f2ccee48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:30.162310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820fe39-ee25-4227-8db7-eb69f2ccee48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.163778 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820fe39-ee25-4227-8db7-eb69f2ccee48 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.180245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 524/1044] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:30.181537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820fe39-ee25-4227-8db7-eb69f2ccee48 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.228185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.273210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b97a43-d80e-44cb-b195-62b0b70f5669 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.274676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.291467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820fe39-ee25-4227-8db7-eb69f2ccee48 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.316228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231a2fe-c32e-428e-b4ef-6ed843e17dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.318286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a2fe-c32e-428e-b4ef-6ed843e17dcc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.318825 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a2fe-c32e-428e-b4ef-6ed843e17dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.319378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a2fe-c32e-428e-b4ef-6ed843e17dcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.334340 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231a2fe-c32e-428e-b4ef-6ed843e17dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:30.334528 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19ac8c-dc65-4aac-b413-ea3f6377dfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.335501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19ac8c-dc65-4aac-b413-ea3f6377dfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.335934 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19ac8c-dc65-4aac-b413-ea3f6377dfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.336359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19ac8c-dc65-4aac-b413-ea3f6377dfb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.343595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19ac8c-dc65-4aac-b413-ea3f6377dfb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-9231a2fe-c32e-428e-b4ef-6ed843e17dcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:30.343786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:30.344995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:30.346061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:30.353332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 521/1045] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:30.353468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19ac8c-dc65-4aac-b413-ea3f6377dfb7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.354365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231a2fe-c32e-428e-b4ef-6ed843e17dcc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3d19ac8c-dc65-4aac-b413-ea3f6377dfb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:30.371666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:30.372865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:30.373999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:30.373999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:30.373999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:30.373999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:30.373999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:30.373999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:30.373999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:30.373999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:30.380899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 525/1046] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:30.381819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19ac8c-dc65-4aac-b413-ea3f6377dfb7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.463019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231a2fe-c32e-428e-b4ef-6ed843e17dcc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.491111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19ac8c-dc65-4aac-b413-ea3f6377dfb7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.493968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.498361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d999b-a7a3-47d3-915f-f8cc7af6eee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.499043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d999b-a7a3-47d3-915f-f8cc7af6eee9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.499332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d999b-a7a3-47d3-915f-f8cc7af6eee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.499770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d999b-a7a3-47d3-915f-f8cc7af6eee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.500366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d999b-a7a3-47d3-915f-f8cc7af6eee9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:30.500714 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d999b-a7a3-47d3-915f-f8cc7af6eee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.502100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d999b-a7a3-47d3-915f-f8cc7af6eee9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.516297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 522/1047] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:30.517222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d999b-a7a3-47d3-915f-f8cc7af6eee9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.529613 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb8299-4763-499a-a25b-58fffbdb2a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.530224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb8299-4763-499a-a25b-58fffbdb2a83 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.530440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb8299-4763-499a-a25b-58fffbdb2a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.530715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb8299-4763-499a-a25b-58fffbdb2a83 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.531505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb8299-4763-499a-a25b-58fffbdb2a83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:30.531818 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb8299-4763-499a-a25b-58fffbdb2a83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.533328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb8299-4763-499a-a25b-58fffbdb2a83 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.544948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.553416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 526/1048] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:30.554508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb8299-4763-499a-a25b-58fffbdb2a83 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.643744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d999b-a7a3-47d3-915f-f8cc7af6eee9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.678669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb8299-4763-499a-a25b-58fffbdb2a83 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.681689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e569e-0420-4660-8f14-ae65fa97b615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.682568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e569e-0420-4660-8f14-ae65fa97b615 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.682850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e569e-0420-4660-8f14-ae65fa97b615 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.683126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e569e-0420-4660-8f14-ae65fa97b615 None admin] PATH_INFO: `/v3/users/d2dcc7eac3034f7c85acb1b43635d0d6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.699925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e569e-0420-4660-8f14-ae65fa97b615 None admin] RBAC: Authorizing `identity:get_user(user_id=d2dcc7eac3034f7c85acb1b43635d0d6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.701402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e569e-0420-4660-8f14-ae65fa97b615 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.703471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 523/1049] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/users/d2dcc7eac3034f7c85acb1b43635d0d6 => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:30.704819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8792c44-87dc-47fd-8dcf-07fb16c27258 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.705108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8792c44-87dc-47fd-8dcf-07fb16c27258 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.705389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8792c44-87dc-47fd-8dcf-07fb16c27258 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.707381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 524/1050] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:30.709388 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8792c44-87dc-47fd-8dcf-07fb16c27258 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.722898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619fd02-3833-4c15-b029-cc2ac6f01df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.723566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619fd02-3833-4c15-b029-cc2ac6f01df2 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.723853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619fd02-3833-4c15-b029-cc2ac6f01df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.724131 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619fd02-3833-4c15-b029-cc2ac6f01df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.725003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619fd02-3833-4c15-b029-cc2ac6f01df2 None admin] RBAC: Adding query filter params (role.id=aabc773ecbd1409e8482cff30512ac1e, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=3748d8369d20429eb2376ce02d42eee0) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:30.725317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619fd02-3833-4c15-b029-cc2ac6f01df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.726825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619fd02-3833-4c15-b029-cc2ac6f01df2 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.732445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 527/1051] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/role_assignments?user.id=3748d8369d20429eb2376ce02d42eee0&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=aabc773ecbd1409e8482cff30512ac1e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:30.733795 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f15c7-0b5c-47e9-a77c-84167d6ba38d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.734091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f15c7-0b5c-47e9-a77c-84167d6ba38d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.734516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f15c7-0b5c-47e9-a77c-84167d6ba38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.752439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-867f15c7-0b5c-47e9-a77c-84167d6ba38d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:30.754390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-867f15c7-0b5c-47e9-a77c-84167d6ba38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:30.783447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.808672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:30.833135 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8792c44-87dc-47fd-8dcf-07fb16c27258 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:30.838802 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 528/1052] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:30.863967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f15c7-0b5c-47e9-a77c-84167d6ba38d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:30.872108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28874bc-bfe1-435a-9929-4aca12f02b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:30.872908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28874bc-bfe1-435a-9929-4aca12f02b50 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:30.873265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28874bc-bfe1-435a-9929-4aca12f02b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:30.873612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28874bc-bfe1-435a-9929-4aca12f02b50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:30.949545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28874bc-bfe1-435a-9929-4aca12f02b50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:30.950998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28874bc-bfe1-435a-9929-4aca12f02b50 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:30.973577 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f15c7-0b5c-47e9-a77c-84167d6ba38d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:31.010331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82117e3-1a3e-4333-91d5-b9951652f6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:31.011123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82117e3-1a3e-4333-91d5-b9951652f6bc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:31.011412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82117e3-1a3e-4333-91d5-b9951652f6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:31.011692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82117e3-1a3e-4333-91d5-b9951652f6bc None admin] PATH_INFO: `/v3/services/image` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.012354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82117e3-1a3e-4333-91d5-b9951652f6bc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.013774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82117e3-1a3e-4333-91d5-b9951652f6bc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-b82117e3-1a3e-4333-91d5-b9951652f6bc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:31.025941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:31.027163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 06:01:31.028194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:31.032199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 529/1053] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:31.032973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82117e3-1a3e-4333-91d5-b9951652f6bc None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:31.037460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:31.059957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 525/1054] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 06:01:31.060654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:31.065633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28874bc-bfe1-435a-9929-4aca12f02b50 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:31.148913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82117e3-1a3e-4333-91d5-b9951652f6bc None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:31.170088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28874bc-bfe1-435a-9929-4aca12f02b50 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:31.186373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d00b-2f18-4ca8-9ef8-7f593a5d99db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:31.187039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d00b-2f18-4ca8-9ef8-7f593a5d99db None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:31.187322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d00b-2f18-4ca8-9ef8-7f593a5d99db None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:31.187602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d00b-2f18-4ca8-9ef8-7f593a5d99db None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.188310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80d00b-2f18-4ca8-9ef8-7f593a5d99db None admin] RBAC: Adding query filter params (name=image) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:31.188643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80d00b-2f18-4ca8-9ef8-7f593a5d99db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.190019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80d00b-2f18-4ca8-9ef8-7f593a5d99db None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.196582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 530/1055] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:31.201688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d00b-2f18-4ca8-9ef8-7f593a5d99db None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:31.211038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c758f0-c77b-4876-9d1e-8f6780e721e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:31.212150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c758f0-c77b-4876-9d1e-8f6780e721e7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:31.212150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c758f0-c77b-4876-9d1e-8f6780e721e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:31.212450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c758f0-c77b-4876-9d1e-8f6780e721e7 None admin] PATH_INFO: `/v3/projects/931293ccafe4448292fc1007c2f798f4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.213670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c758f0-c77b-4876-9d1e-8f6780e721e7 None admin] RBAC: Authorizing `identity:get_project(project_id=931293ccafe4448292fc1007c2f798f4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.215113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c758f0-c77b-4876-9d1e-8f6780e721e7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.217274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 526/1056] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:01:31 2022] GET /identity/v3/projects/931293ccafe4448292fc1007c2f798f4 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:31.223177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c758f0-c77b-4876-9d1e-8f6780e721e7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:31.279051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:31.299785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:31.316724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d00b-2f18-4ca8-9ef8-7f593a5d99db None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:31.333362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c758f0-c77b-4876-9d1e-8f6780e721e7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:31.353776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fda92-81d3-4131-8754-7b1b7bce78c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:31.354442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fda92-81d3-4131-8754-7b1b7bce78c3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:31.354726 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fda92-81d3-4131-8754-7b1b7bce78c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:31.355000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fda92-81d3-4131-8754-7b1b7bce78c3 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.355705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fda92-81d3-4131-8754-7b1b7bce78c3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:31.356013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fda92-81d3-4131-8754-7b1b7bce78c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.357412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fda92-81d3-4131-8754-7b1b7bce78c3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.362485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 531/1057] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:31.368078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fda92-81d3-4131-8754-7b1b7bce78c3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:31.370161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204b8c0-a89b-41b4-b765-1b66b2dbce6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:31.371008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204b8c0-a89b-41b4-b765-1b66b2dbce6e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:31.371471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204b8c0-a89b-41b4-b765-1b66b2dbce6e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:31.371752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204b8c0-a89b-41b4-b765-1b66b2dbce6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.372597 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204b8c0-a89b-41b4-b765-1b66b2dbce6e None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=931293ccafe4448292fc1007c2f798f4, user.id=d2dcc7eac3034f7c85acb1b43635d0d6) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:31.372944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204b8c0-a89b-41b4-b765-1b66b2dbce6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.374375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204b8c0-a89b-41b4-b765-1b66b2dbce6e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.382902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 527/1058] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:31 2022] GET /identity/v3/role_assignments?user.id=d2dcc7eac3034f7c85acb1b43635d0d6&scope.project.id=931293ccafe4448292fc1007c2f798f4&role.id=efc16976111d431c9173186cbd0e6c24 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:31.490843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fda92-81d3-4131-8754-7b1b7bce78c3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:31.527504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30339e60-e52c-4901-9726-9e8ba89f819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:31.528241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30339e60-e52c-4901-9726-9e8ba89f819c None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:31.528528 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30339e60-e52c-4901-9726-9e8ba89f819c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:31.528836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30339e60-e52c-4901-9726-9e8ba89f819c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:31.529588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30339e60-e52c-4901-9726-9e8ba89f819c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:31.530969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30339e60-e52c-4901-9726-9e8ba89f819c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:31.552710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 532/1059] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jun 20 06:01:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:32.813846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b276d-a123-4b05-9948-db1692e17d56 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:32.814462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b276d-a123-4b05-9948-db1692e17d56 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:32.814462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b276d-a123-4b05-9948-db1692e17d56 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:32.816424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 528/1060] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:32.821913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9975a-6294-4e61-b584-757abe38a2e4 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:32.822329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9975a-6294-4e61-b584-757abe38a2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:32.822500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9975a-6294-4e61-b584-757abe38a2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:32.834545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:32.840812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-13a9975a-6294-4e61-b584-757abe38a2e4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:32.842637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-13a9975a-6294-4e61-b584-757abe38a2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:32.920725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 533/1061] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:32.939505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b276d-a123-4b05-9948-db1692e17d56 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.045246 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b276d-a123-4b05-9948-db1692e17d56 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.059382 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:33.080334 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf15f93-7aeb-4223-9d64-744175dc8161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.081175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf15f93-7aeb-4223-9d64-744175dc8161 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.081466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf15f93-7aeb-4223-9d64-744175dc8161 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.082271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf15f93-7aeb-4223-9d64-744175dc8161 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.092346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf15f93-7aeb-4223-9d64-744175dc8161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4cf15f93-7aeb-4223-9d64-744175dc8161 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:33.100641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:33.101650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:33.102567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:33.104690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 529/1062] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jun 20 06:01:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:33.107965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9975a-6294-4e61-b584-757abe38a2e4 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.215535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9975a-6294-4e61-b584-757abe38a2e4 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.245087 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:33.251564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81906ab0-d65a-47d7-851c-68ddf09906da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.252234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81906ab0-d65a-47d7-851c-68ddf09906da None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.252515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81906ab0-d65a-47d7-851c-68ddf09906da None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.252815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81906ab0-d65a-47d7-851c-68ddf09906da None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.254123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81906ab0-d65a-47d7-851c-68ddf09906da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:33.254486 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81906ab0-d65a-47d7-851c-68ddf09906da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:33.255892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81906ab0-d65a-47d7-851c-68ddf09906da None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:33.268916 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 534/1063] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:33.270508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf15f93-7aeb-4223-9d64-744175dc8161 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.376628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf15f93-7aeb-4223-9d64-744175dc8161 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.411216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c591275-d29c-4c28-8bd2-7c80da8b554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.412019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591275-d29c-4c28-8bd2-7c80da8b554f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.412311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591275-d29c-4c28-8bd2-7c80da8b554f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.412593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591275-d29c-4c28-8bd2-7c80da8b554f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.419427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bf570-9397-4706-986e-cb1d3544e564 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.419725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bf570-9397-4706-986e-cb1d3544e564 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.420009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bf570-9397-4706-986e-cb1d3544e564 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.421578 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 535/1064] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:33.423911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c591275-d29c-4c28-8bd2-7c80da8b554f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:33.425960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c591275-d29c-4c28-8bd2-7c80da8b554f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:33.426977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d5ce-05ab-4e3c-9b75-55687574fd4a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.427274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d5ce-05ab-4e3c-9b75-55687574fd4a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.427560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d5ce-05ab-4e3c-9b75-55687574fd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.444747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8150d5ce-05ab-4e3c-9b75-55687574fd4a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:33.446252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8150d5ce-05ab-4e3c-9b75-55687574fd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-1c591275-d29c-4c28-8bd2-7c80da8b554f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:33.448793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:33.449744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:33.450698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:33.450698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:33.450698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:33.450698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:33.450698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 530/1065] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:33.455502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c591275-d29c-4c28-8bd2-7c80da8b554f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.484870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:33.528650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 536/1066] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:33.553235 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d5ce-05ab-4e3c-9b75-55687574fd4a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.563372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c591275-d29c-4c28-8bd2-7c80da8b554f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.601566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9141609-ad97-404d-ab95-3aec92378fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.602376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141609-ad97-404d-ab95-3aec92378fde None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.602669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141609-ad97-404d-ab95-3aec92378fde None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.602954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141609-ad97-404d-ab95-3aec92378fde None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.603689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9141609-ad97-404d-ab95-3aec92378fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:33.604001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9141609-ad97-404d-ab95-3aec92378fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:33.605411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9141609-ad97-404d-ab95-3aec92378fde None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:33.618206 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 531/1067] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:33.625850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9141609-ad97-404d-ab95-3aec92378fde None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.667519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d5ce-05ab-4e3c-9b75-55687574fd4a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.696023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:33.708408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e30e01-bfe0-4ecf-8f1e-35341cac1cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.709236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e30e01-bfe0-4ecf-8f1e-35341cac1cbf None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.709524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e30e01-bfe0-4ecf-8f1e-35341cac1cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.709805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e30e01-bfe0-4ecf-8f1e-35341cac1cbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.717149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:33.720172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e30e01-bfe0-4ecf-8f1e-35341cac1cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-a2e30e01-bfe0-4ecf-8f1e-35341cac1cbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:33.727913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:33.728947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:33.729809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:33.732877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9141609-ad97-404d-ab95-3aec92378fde None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.734214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 537/1068] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:33.735580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2d027-e68e-43fe-8be2-5c82f78bcc70 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.735821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2d027-e68e-43fe-8be2-5c82f78bcc70 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.736107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2d027-e68e-43fe-8be2-5c82f78bcc70 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.737448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 538/1069] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:33.738153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2d027-e68e-43fe-8be2-5c82f78bcc70 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.768770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c548ddb-2232-4060-9a24-92c9e3fe2eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.770654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c548ddb-2232-4060-9a24-92c9e3fe2eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.770941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c548ddb-2232-4060-9a24-92c9e3fe2eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.771214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c548ddb-2232-4060-9a24-92c9e3fe2eb3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.778348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c548ddb-2232-4060-9a24-92c9e3fe2eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:33.779792 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c548ddb-2232-4060-9a24-92c9e3fe2eb3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6c548ddb-2232-4060-9a24-92c9e3fe2eb3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:33.794566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:33.795560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:33.796538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:33.796538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:33.796538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:33.796538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:33.796538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:33.796538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:33.796538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:33.796538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:33.796538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:01:33.796538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:33.796538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 532/1070] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:33.797369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11251e0-664f-4348-9ca7-3381e677f4ca None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.797369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11251e0-664f-4348-9ca7-3381e677f4ca None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.797508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11251e0-664f-4348-9ca7-3381e677f4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.815537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b11251e0-664f-4348-9ca7-3381e677f4ca None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:33.817415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b11251e0-664f-4348-9ca7-3381e677f4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:33.844635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2d027-e68e-43fe-8be2-5c82f78bcc70 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.877899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5d3c1-70ff-4d2c-94cd-3b431df34571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:33.879120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d3c1-70ff-4d2c-94cd-3b431df34571 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:33.879396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d3c1-70ff-4d2c-94cd-3b431df34571 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:33.879671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d3c1-70ff-4d2c-94cd-3b431df34571 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:33.880412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5d3c1-70ff-4d2c-94cd-3b431df34571 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:33.880752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5d3c1-70ff-4d2c-94cd-3b431df34571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:33.882134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5d3c1-70ff-4d2c-94cd-3b431df34571 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:33.883288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 533/1071] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:33.884113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11251e0-664f-4348-9ca7-3381e677f4ca None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.897569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 539/1072] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:33.898610 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5d3c1-70ff-4d2c-94cd-3b431df34571 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:33.944194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:33.965709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:33.989811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11251e0-664f-4348-9ca7-3381e677f4ca None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:33.997488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5d3c1-70ff-4d2c-94cd-3b431df34571 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.023759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ba079-3aec-47cf-8f3f-294a36e0f2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.024429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba079-3aec-47cf-8f3f-294a36e0f2fd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.024744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba079-3aec-47cf-8f3f-294a36e0f2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.025023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba079-3aec-47cf-8f3f-294a36e0f2fd None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.025850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ba079-3aec-47cf-8f3f-294a36e0f2fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:34.026160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ba079-3aec-47cf-8f3f-294a36e0f2fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.027580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ba079-3aec-47cf-8f3f-294a36e0f2fd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.030866 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe38bf-bc17-449e-9416-815bffa4cf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.031731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe38bf-bc17-449e-9416-815bffa4cf2a None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.032015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe38bf-bc17-449e-9416-815bffa4cf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.032291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe38bf-bc17-449e-9416-815bffa4cf2a None admin] PATH_INFO: `/v3/users/d2dcc7eac3034f7c85acb1b43635d0d6` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.033522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe38bf-bc17-449e-9416-815bffa4cf2a None admin] RBAC: Authorizing `identity:get_user(user_id=d2dcc7eac3034f7c85acb1b43635d0d6)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.035946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe38bf-bc17-449e-9416-815bffa4cf2a None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.037827 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 540/1073] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/users/d2dcc7eac3034f7c85acb1b43635d0d6 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:34.038436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe38bf-bc17-449e-9416-815bffa4cf2a None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.046713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 534/1074] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jun 20 06:01:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:34.047523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ba079-3aec-47cf-8f3f-294a36e0f2fd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.140589 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe38bf-bc17-449e-9416-815bffa4cf2a None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.150511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ba079-3aec-47cf-8f3f-294a36e0f2fd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.154812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:34.177456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26b190-1e6a-4092-bcef-12ded72a1571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.178104 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26b190-1e6a-4092-bcef-12ded72a1571 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.178389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26b190-1e6a-4092-bcef-12ded72a1571 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.178673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26b190-1e6a-4092-bcef-12ded72a1571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.184036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9590762-33ea-4c1a-9205-0d73845a23ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.184910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9590762-33ea-4c1a-9205-0d73845a23ca None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.185195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9590762-33ea-4c1a-9205-0d73845a23ca None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.185470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9590762-33ea-4c1a-9205-0d73845a23ca None admin] PATH_INFO: `/v3/projects/931293ccafe4448292fc1007c2f798f4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.186629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9590762-33ea-4c1a-9205-0d73845a23ca None admin] RBAC: Authorizing `identity:get_project(project_id=931293ccafe4448292fc1007c2f798f4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.188058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9590762-33ea-4c1a-9205-0d73845a23ca None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.189838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 535/1075] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:01:34 2022] GET /identity/v3/projects/931293ccafe4448292fc1007c2f798f4 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:34.190584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9590762-33ea-4c1a-9205-0d73845a23ca None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.196890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:34.253177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26b190-1e6a-4092-bcef-12ded72a1571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.254759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26b190-1e6a-4092-bcef-12ded72a1571 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.297845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9590762-33ea-4c1a-9205-0d73845a23ca None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.332582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef9052-c754-49df-ae14-349edf85ae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.333418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef9052-c754-49df-ae14-349edf85ae57 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.333708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef9052-c754-49df-ae14-349edf85ae57 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.333990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef9052-c754-49df-ae14-349edf85ae57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.343823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef9052-c754-49df-ae14-349edf85ae57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.345300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef9052-c754-49df-ae14-349edf85ae57 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.352919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 541/1076] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:34.353891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26b190-1e6a-4092-bcef-12ded72a1571 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b6ef9052-c754-49df-ae14-349edf85ae57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:34.366704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:34.367648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:34.368575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:34.368575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:34.368575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:34.368575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:34.368575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 536/1077] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:34.368895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef9052-c754-49df-ae14-349edf85ae57 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.375242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:34.423823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:34.460661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26b190-1e6a-4092-bcef-12ded72a1571 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.468965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef9052-c754-49df-ae14-349edf85ae57 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.496147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b0f5-1847-4d52-b213-cd0d7014d35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.497053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b0f5-1847-4d52-b213-cd0d7014d35c None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.497336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b0f5-1847-4d52-b213-cd0d7014d35c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.497606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b0f5-1847-4d52-b213-cd0d7014d35c None admin] PATH_INFO: `/v3/projects/931293ccafe4448292fc1007c2f798f4/users/d2dcc7eac3034f7c85acb1b43635d0d6/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.499512 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225b0f5-1847-4d52-b213-cd0d7014d35c None admin] RBAC: Authorizing `identity:create_grant(project_id=931293ccafe4448292fc1007c2f798f4, user_id=d2dcc7eac3034f7c85acb1b43635d0d6, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.500969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225b0f5-1847-4d52-b213-cd0d7014d35c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.505929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6740d-42cb-4772-ab4b-a6abc4efca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.506843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6740d-42cb-4772-ab4b-a6abc4efca9d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.507094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6740d-42cb-4772-ab4b-a6abc4efca9d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.507404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6740d-42cb-4772-ab4b-a6abc4efca9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.513748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 542/1078] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:01:34 2022] PUT /identity/v3/projects/931293ccafe4448292fc1007c2f798f4/users/d2dcc7eac3034f7c85acb1b43635d0d6/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:01:34.514535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b0f5-1847-4d52-b213-cd0d7014d35c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.517882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6740d-42cb-4772-ab4b-a6abc4efca9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.519643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6740d-42cb-4772-ab4b-a6abc4efca9d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-1aa6740d-42cb-4772-ab4b-a6abc4efca9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:34.540847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:34.541877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:34.542976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:34.542976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:34.542976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:34.542976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:34.542976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 537/1079] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:34.548314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6740d-42cb-4772-ab4b-a6abc4efca9d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.628649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:34.657554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b0f5-1847-4d52-b213-cd0d7014d35c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.672388 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6740d-42cb-4772-ab4b-a6abc4efca9d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.682510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:34.699243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1356f04-7c05-4525-a373-18be67693e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.700039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1356f04-7c05-4525-a373-18be67693e83 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.700202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1356f04-7c05-4525-a373-18be67693e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.700482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1356f04-7c05-4525-a373-18be67693e83 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.701243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1356f04-7c05-4525-a373-18be67693e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:34.701560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1356f04-7c05-4525-a373-18be67693e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.702942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1356f04-7c05-4525-a373-18be67693e83 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.715766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 543/1080] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:34.716783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e4ac9-781c-48dd-809e-83ab81c479ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.717458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e4ac9-781c-48dd-809e-83ab81c479ad None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.717743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e4ac9-781c-48dd-809e-83ab81c479ad None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.718023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e4ac9-781c-48dd-809e-83ab81c479ad None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.718758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e4ac9-781c-48dd-809e-83ab81c479ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:34.719074 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e4ac9-781c-48dd-809e-83ab81c479ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.720461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e4ac9-781c-48dd-809e-83ab81c479ad None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.721196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1356f04-7c05-4525-a373-18be67693e83 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:34.732594 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 538/1081] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:34.835246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1356f04-7c05-4525-a373-18be67693e83 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:34.873870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbfc19-f9a8-4be2-b318-3b60bc94adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:34.874732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbfc19-f9a8-4be2-b318-3b60bc94adde None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:34.875024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbfc19-f9a8-4be2-b318-3b60bc94adde None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:34.875306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbfc19-f9a8-4be2-b318-3b60bc94adde None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:34.877596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:34.886908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbfc19-f9a8-4be2-b318-3b60bc94adde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:34.888290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbfc19-f9a8-4be2-b318-3b60bc94adde None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-96cbfc19-f9a8-4be2-b318-3b60bc94adde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:34.903070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:34.904001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:34.904946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:34.904946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:34.904946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:34.904946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:34.904946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:34.904946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:34.904946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:34.904946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:34.904946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 544/1082] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:34.911055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e4ac9-781c-48dd-809e-83ab81c479ad None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:35.025923 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e4ac9-781c-48dd-809e-83ab81c479ad None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:35.059749 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7c96c-46ba-4c70-9348-cee488ea621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:35.060418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7c96c-46ba-4c70-9348-cee488ea621c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:35.060737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7c96c-46ba-4c70-9348-cee488ea621c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:35.061021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7c96c-46ba-4c70-9348-cee488ea621c None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:35.061821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7c96c-46ba-4c70-9348-cee488ea621c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:35.062135 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7c96c-46ba-4c70-9348-cee488ea621c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:35.063561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7c96c-46ba-4c70-9348-cee488ea621c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:35.076077 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 539/1083] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:35.082603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbfc19-f9a8-4be2-b318-3b60bc94adde None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:35.180270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbfc19-f9a8-4be2-b318-3b60bc94adde None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:35.213811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83029446-9f08-4da7-b7bc-046665d2894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:35.214699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029446-9f08-4da7-b7bc-046665d2894d None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:35.214984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029446-9f08-4da7-b7bc-046665d2894d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:35.215262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029446-9f08-4da7-b7bc-046665d2894d None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/3748d8369d20429eb2376ce02d42eee0/roles/aabc773ecbd1409e8482cff30512ac1e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:35.217498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83029446-9f08-4da7-b7bc-046665d2894d None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=3748d8369d20429eb2376ce02d42eee0, role_id=aabc773ecbd1409e8482cff30512ac1e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:35.218939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83029446-9f08-4da7-b7bc-046665d2894d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:35.232560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 545/1084] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:01:35 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/3748d8369d20429eb2376ce02d42eee0/roles/aabc773ecbd1409e8482cff30512ac1e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:01:36.541630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a860ab-4b35-4d28-aa2d-ee08bf1a6d9e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.542189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a860ab-4b35-4d28-aa2d-ee08bf1a6d9e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.542189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a860ab-4b35-4d28-aa2d-ee08bf1a6d9e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.543705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 540/1085] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:36.548766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7db6-aadf-4d6d-a1dd-e75f6469a573 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.549156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7db6-aadf-4d6d-a1dd-e75f6469a573 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.549324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb7db6-aadf-4d6d-a1dd-e75f6469a573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.567264 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-61fb7db6-aadf-4d6d-a1dd-e75f6469a573 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:36.568440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-61fb7db6-aadf-4d6d-a1dd-e75f6469a573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:36.617052 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:36.639989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 546/1086] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:36.664330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a860ab-4b35-4d28-aa2d-ee08bf1a6d9e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:36.693021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:36.765297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a860ab-4b35-4d28-aa2d-ee08bf1a6d9e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:36.798429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f2db-4af5-4969-90f4-d7de5a33071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:36.799142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f2db-4af5-4969-90f4-d7de5a33071d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.799422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f2db-4af5-4969-90f4-d7de5a33071d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.799695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f2db-4af5-4969-90f4-d7de5a33071d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.810257 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68f2db-4af5-4969-90f4-d7de5a33071d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-8f68f2db-4af5-4969-90f4-d7de5a33071d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:36.818370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:36.819296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:36.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 541/1087] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:36.825441 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb7db6-aadf-4d6d-a1dd-e75f6469a573 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:36.922415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb7db6-aadf-4d6d-a1dd-e75f6469a573 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:36.956476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331508d-d068-4dfa-b01e-ad6f01384aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:36.957266 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331508d-d068-4dfa-b01e-ad6f01384aca None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:36.957551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331508d-d068-4dfa-b01e-ad6f01384aca None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:36.957825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331508d-d068-4dfa-b01e-ad6f01384aca None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:36.958578 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331508d-d068-4dfa-b01e-ad6f01384aca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:36.958889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331508d-d068-4dfa-b01e-ad6f01384aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:36.960269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331508d-d068-4dfa-b01e-ad6f01384aca None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:36.968251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 547/1088] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:36.973919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f2db-4af5-4969-90f4-d7de5a33071d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.058333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.074215 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f2db-4af5-4969-90f4-d7de5a33071d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.106301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d87a70-92ce-4172-9473-8cfb8e31c1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.107172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d87a70-92ce-4172-9473-8cfb8e31c1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.107464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d87a70-92ce-4172-9473-8cfb8e31c1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.107743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d87a70-92ce-4172-9473-8cfb8e31c1d2 None admin] PATH_INFO: `/v3/users/d2dcc7eac3034f7c85acb1b43635d0d6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.108958 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d87a70-92ce-4172-9473-8cfb8e31c1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=d2dcc7eac3034f7c85acb1b43635d0d6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:37.110397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d87a70-92ce-4172-9473-8cfb8e31c1d2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:37.112018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 542/1089] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:01:36 2022] GET /identity/v3/users/d2dcc7eac3034f7c85acb1b43635d0d6 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:37.118321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331508d-d068-4dfa-b01e-ad6f01384aca None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.164915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.217509 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331508d-d068-4dfa-b01e-ad6f01384aca None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.249857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85e154-a686-4b20-a307-0cbf2406bc21 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.250151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85e154-a686-4b20-a307-0cbf2406bc21 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.250433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85e154-a686-4b20-a307-0cbf2406bc21 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.251797 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 543/1090] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:01:37.252267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3aaa5-a8ab-47e1-ba8f-c6723552a059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.253017 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3aaa5-a8ab-47e1-ba8f-c6723552a059 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.254036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3aaa5-a8ab-47e1-ba8f-c6723552a059 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.254575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3aaa5-a8ab-47e1-ba8f-c6723552a059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.257187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919d88-bb2f-40d0-b65e-36f7c2e1dbfc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.257476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919d88-bb2f-40d0-b65e-36f7c2e1dbfc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.257753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919d88-bb2f-40d0-b65e-36f7c2e1dbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.274349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c1919d88-bb2f-40d0-b65e-36f7c2e1dbfc None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:37.275520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c1919d88-bb2f-40d0-b65e-36f7c2e1dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:37.323993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3aaa5-a8ab-47e1-ba8f-c6723552a059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:37.325415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3aaa5-a8ab-47e1-ba8f-c6723552a059 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:37.345112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 544/1091] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:37.369162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919d88-bb2f-40d0-b65e-36f7c2e1dbfc None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.371659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.427135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 548/1092] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:37.432945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3aaa5-a8ab-47e1-ba8f-c6723552a059 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.451116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.467543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919d88-bb2f-40d0-b65e-36f7c2e1dbfc None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.500663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375119bb-bd24-49da-89d5-b642ee5ca306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.501465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375119bb-bd24-49da-89d5-b642ee5ca306 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.501748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375119bb-bd24-49da-89d5-b642ee5ca306 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.502021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375119bb-bd24-49da-89d5-b642ee5ca306 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.513060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375119bb-bd24-49da-89d5-b642ee5ca306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-375119bb-bd24-49da-89d5-b642ee5ca306 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:37.521573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:37.522624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:37.523529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 545/1093] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:37.528672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375119bb-bd24-49da-89d5-b642ee5ca306 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.531042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3aaa5-a8ab-47e1-ba8f-c6723552a059 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.566177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127ef0c-b917-4930-bd83-e717d84ef1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.567024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127ef0c-b917-4930-bd83-e717d84ef1ee None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.567303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127ef0c-b917-4930-bd83-e717d84ef1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.567581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127ef0c-b917-4930-bd83-e717d84ef1ee None admin] PATH_INFO: `/v3/projects/931293ccafe4448292fc1007c2f798f4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.568826 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127ef0c-b917-4930-bd83-e717d84ef1ee None admin] RBAC: Authorizing `identity:get_project(project_id=931293ccafe4448292fc1007c2f798f4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:37.570247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127ef0c-b917-4930-bd83-e717d84ef1ee None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:37.571937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 549/1094] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/projects/931293ccafe4448292fc1007c2f798f4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:37.578026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127ef0c-b917-4930-bd83-e717d84ef1ee None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.593870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.629570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375119bb-bd24-49da-89d5-b642ee5ca306 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.662569 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb1568-25e5-45ce-972d-947be9e4c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.663234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb1568-25e5-45ce-972d-947be9e4c38f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.663518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb1568-25e5-45ce-972d-947be9e4c38f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.663795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb1568-25e5-45ce-972d-947be9e4c38f None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.664533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb1568-25e5-45ce-972d-947be9e4c38f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:37.664868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb1568-25e5-45ce-972d-947be9e4c38f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:37.666268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb1568-25e5-45ce-972d-947be9e4c38f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:37.674052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 546/1095] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:37.680053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb1568-25e5-45ce-972d-947be9e4c38f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.683046 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127ef0c-b917-4930-bd83-e717d84ef1ee None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.689371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.717817 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7207f-5f0b-4e15-872d-e3ec4cf52ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.718471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7207f-5f0b-4e15-872d-e3ec4cf52ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.718757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7207f-5f0b-4e15-872d-e3ec4cf52ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.719028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7207f-5f0b-4e15-872d-e3ec4cf52ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.719855 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7207f-5f0b-4e15-872d-e3ec4cf52ea7 None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=931293ccafe4448292fc1007c2f798f4, user.id=d2dcc7eac3034f7c85acb1b43635d0d6) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:37.720166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7207f-5f0b-4e15-872d-e3ec4cf52ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:37.721633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7207f-5f0b-4e15-872d-e3ec4cf52ea7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:37.728128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 550/1096] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/role_assignments?user.id=d2dcc7eac3034f7c85acb1b43635d0d6&scope.project.id=931293ccafe4448292fc1007c2f798f4&role.id=efc16976111d431c9173186cbd0e6c24 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:37.791399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb1568-25e5-45ce-972d-947be9e4c38f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:37.827324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d80353-de0b-4401-ab64-0cce00ef8841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:37.828188 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80353-de0b-4401-ab64-0cce00ef8841 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:37.828418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80353-de0b-4401-ab64-0cce00ef8841 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:37.828722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80353-de0b-4401-ab64-0cce00ef8841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:37.841503 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d80353-de0b-4401-ab64-0cce00ef8841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:37.843019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d80353-de0b-4401-ab64-0cce00ef8841 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-18d80353-de0b-4401-ab64-0cce00ef8841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:37.862065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:37.863291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:37.864244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:37.864244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:37.864244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:37.864244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:37.864244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 547/1097] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:37.869461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7207f-5f0b-4e15-872d-e3ec4cf52ea7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:37.952961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:37.974740 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7207f-5f0b-4e15-872d-e3ec4cf52ea7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:38.008158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073746a-32dd-4e54-bf44-5c10afbbe20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:38.008858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073746a-32dd-4e54-bf44-5c10afbbe20e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:38.009146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073746a-32dd-4e54-bf44-5c10afbbe20e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:38.009426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073746a-32dd-4e54-bf44-5c10afbbe20e None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:38.010150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073746a-32dd-4e54-bf44-5c10afbbe20e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:38.010463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073746a-32dd-4e54-bf44-5c10afbbe20e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:38.011847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073746a-32dd-4e54-bf44-5c10afbbe20e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:38.023652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 551/1098] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:38.029204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d80353-de0b-4401-ab64-0cce00ef8841 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:38.087403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:38.131082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d80353-de0b-4401-ab64-0cce00ef8841 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:38.164134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d129c-d134-4d9c-aa49-4a79f49e4d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:38.164949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d129c-d134-4d9c-aa49-4a79f49e4d2b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:38.165233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d129c-d134-4d9c-aa49-4a79f49e4d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:38.165510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d129c-d134-4d9c-aa49-4a79f49e4d2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:38.172892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d129c-d134-4d9c-aa49-4a79f49e4d2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:38.174326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d129c-d134-4d9c-aa49-4a79f49e4d2b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-287d129c-d134-4d9c-aa49-4a79f49e4d2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:01:38.188692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:38.189848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:38.191401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:38.191401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:38.191401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:01:38.191401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:01:38.191401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:01:38.191401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:01:38.191401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:01:38.191401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:01:38.191401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 06:01:38.191401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:38.191401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 548/1099] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jun 20 06:01:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:38.195590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073746a-32dd-4e54-bf44-5c10afbbe20e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:38.294585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073746a-32dd-4e54-bf44-5c10afbbe20e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:38.328179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886c106-deab-4096-b4a5-b965e9275a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:38.328882 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886c106-deab-4096-b4a5-b965e9275a1b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:38.329170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886c106-deab-4096-b4a5-b965e9275a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:38.329450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886c106-deab-4096-b4a5-b965e9275a1b None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:38.330290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886c106-deab-4096-b4a5-b965e9275a1b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:38.330604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886c106-deab-4096-b4a5-b965e9275a1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:38.332574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886c106-deab-4096-b4a5-b965e9275a1b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:38.340316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:38.351941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 552/1100] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jun 20 06:01:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:38.357787 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d129c-d134-4d9c-aa49-4a79f49e4d2b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:38.457485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d129c-d134-4d9c-aa49-4a79f49e4d2b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:38.474286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:38.492086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040d4c-7b45-4dd6-8aee-f61212d09559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:38.492777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040d4c-7b45-4dd6-8aee-f61212d09559 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:38.493067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040d4c-7b45-4dd6-8aee-f61212d09559 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:38.493347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040d4c-7b45-4dd6-8aee-f61212d09559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:38.560544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040d4c-7b45-4dd6-8aee-f61212d09559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:38.562009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040d4c-7b45-4dd6-8aee-f61212d09559 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:38.659291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 549/1101] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:38.665415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886c106-deab-4096-b4a5-b965e9275a1b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:38.763599 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886c106-deab-4096-b4a5-b965e9275a1b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:38.797081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273eeb08-7fce-4e0a-9753-3b32d897cce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:38.797869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273eeb08-7fce-4e0a-9753-3b32d897cce6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:38.798154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273eeb08-7fce-4e0a-9753-3b32d897cce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:38.798431 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273eeb08-7fce-4e0a-9753-3b32d897cce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:38.809172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273eeb08-7fce-4e0a-9753-3b32d897cce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:38.810620 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273eeb08-7fce-4e0a-9753-3b32d897cce6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-273eeb08-7fce-4e0a-9753-3b32d897cce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:01:38.828082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:38.829310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:38.830448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:01:38.830448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:01:38.830448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:01:38.830448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:38.832774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 553/1102] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:38.834872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040d4c-7b45-4dd6-8aee-f61212d09559 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:38.854075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:38.935817 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040d4c-7b45-4dd6-8aee-f61212d09559 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:38.968795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e330c-fe4b-464b-8fd0-9f2072173d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:38.969443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e330c-fe4b-464b-8fd0-9f2072173d0b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:38.969725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e330c-fe4b-464b-8fd0-9f2072173d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:38.970000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e330c-fe4b-464b-8fd0-9f2072173d0b None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:38.970713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e330c-fe4b-464b-8fd0-9f2072173d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:38.971017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e330c-fe4b-464b-8fd0-9f2072173d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:38.973223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e330c-fe4b-464b-8fd0-9f2072173d0b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:38.984280 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 550/1103] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:38.990532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273eeb08-7fce-4e0a-9753-3b32d897cce6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:39.039008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:39.088942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273eeb08-7fce-4e0a-9753-3b32d897cce6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:39.122068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e542a3-04d9-465f-a55d-8be65ca00db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:39.122855 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e542a3-04d9-465f-a55d-8be65ca00db3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:39.123139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e542a3-04d9-465f-a55d-8be65ca00db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:39.123419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e542a3-04d9-465f-a55d-8be65ca00db3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:39.130149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e542a3-04d9-465f-a55d-8be65ca00db3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:39.131596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e542a3-04d9-465f-a55d-8be65ca00db3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-30e542a3-04d9-465f-a55d-8be65ca00db3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:01:39.145596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:39.146640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:39.147551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:01:39.147551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:01:39.147551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:01:39.147551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:01:39.147551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:01:39.147551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:01:39.147551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:01:39.147551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:01:39.147551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 554/1104] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:01:39.152464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e330c-fe4b-464b-8fd0-9f2072173d0b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:39.229810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:39.252008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e330c-fe4b-464b-8fd0-9f2072173d0b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:39.285865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d180d-79b2-4fbf-9021-6ca9deef8f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:39.286526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d180d-79b2-4fbf-9021-6ca9deef8f24 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:39.286813 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d180d-79b2-4fbf-9021-6ca9deef8f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:39.287092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d180d-79b2-4fbf-9021-6ca9deef8f24 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:39.287884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d180d-79b2-4fbf-9021-6ca9deef8f24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:39.288198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d180d-79b2-4fbf-9021-6ca9deef8f24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:39.289703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d180d-79b2-4fbf-9021-6ca9deef8f24 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:39.302164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 551/1105] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:39.308249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e542a3-04d9-465f-a55d-8be65ca00db3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:39.407867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e542a3-04d9-465f-a55d-8be65ca00db3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:39.417145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:39.442939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce717f-1de2-443e-b2e6-f3f9cee3157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:39.443591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce717f-1de2-443e-b2e6-f3f9cee3157f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:39.443876 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce717f-1de2-443e-b2e6-f3f9cee3157f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:39.444153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce717f-1de2-443e-b2e6-f3f9cee3157f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:39.445022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce717f-1de2-443e-b2e6-f3f9cee3157f None admin] RBAC: Adding query filter params (role.id=aabc773ecbd1409e8482cff30512ac1e, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=3748d8369d20429eb2376ce02d42eee0) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:39.445339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce717f-1de2-443e-b2e6-f3f9cee3157f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:39.446770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce717f-1de2-443e-b2e6-f3f9cee3157f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:39.452538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 555/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:39 2022] GET /identity/v3/role_assignments?user.id=3748d8369d20429eb2376ce02d42eee0&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=aabc773ecbd1409e8482cff30512ac1e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:39.830503 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff0af-9e4d-40dd-9b6d-7e3615ab3fc5 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:39.831012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff0af-9e4d-40dd-9b6d-7e3615ab3fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:39.831101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff0af-9e4d-40dd-9b6d-7e3615ab3fc5 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:39.833451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 552/1107] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:39.838604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964122e-a414-48df-960e-ddbb9a3742ce None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:39.839051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964122e-a414-48df-960e-ddbb9a3742ce None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:39.839158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964122e-a414-48df-960e-ddbb9a3742ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:39.857196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d964122e-a414-48df-960e-ddbb9a3742ce None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:39.858383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d964122e-a414-48df-960e-ddbb9a3742ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:39.927832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 556/1108] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:39.953092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff0af-9e4d-40dd-9b6d-7e3615ab3fc5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:40.063499 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff0af-9e4d-40dd-9b6d-7e3615ab3fc5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:40.098655 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f35ea0-b2cc-46eb-a9a0-ea9cd1287096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:40.099452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35ea0-b2cc-46eb-a9a0-ea9cd1287096 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:40.099742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35ea0-b2cc-46eb-a9a0-ea9cd1287096 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:40.100019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35ea0-b2cc-46eb-a9a0-ea9cd1287096 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:40.101236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f35ea0-b2cc-46eb-a9a0-ea9cd1287096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:40.102685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f35ea0-b2cc-46eb-a9a0-ea9cd1287096 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:40.104318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 553/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:40.110118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964122e-a414-48df-960e-ddbb9a3742ce None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:40.214342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964122e-a414-48df-960e-ddbb9a3742ce None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:40.215830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:40.251717 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b028a-3109-4301-be4d-9b780f7c3c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:40.252401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b028a-3109-4301-be4d-9b780f7c3c80 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:40.252788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b028a-3109-4301-be4d-9b780f7c3c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:40.253068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b028a-3109-4301-be4d-9b780f7c3c80 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:40.254643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b028a-3109-4301-be4d-9b780f7c3c80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:40.255938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b028a-3109-4301-be4d-9b780f7c3c80 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:40.277326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 557/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 06:01:40 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:42.353041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd759862-554a-4281-a1ca-93b1a5bc9b3a None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:42.353637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd759862-554a-4281-a1ca-93b1a5bc9b3a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:42.353739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd759862-554a-4281-a1ca-93b1a5bc9b3a None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:42.355304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 554/1111] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:42.360763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7f18-d2e5-4cf3-96b3-478275e8571d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:42.361200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7f18-d2e5-4cf3-96b3-478275e8571d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:42.361335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7f18-d2e5-4cf3-96b3-478275e8571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:42.379882 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-750a7f18-d2e5-4cf3-96b3-478275e8571d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:42.381121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-750a7f18-d2e5-4cf3-96b3-478275e8571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:42.446731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 558/1112] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:42.470257 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd759862-554a-4281-a1ca-93b1a5bc9b3a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:42.479459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:42.573489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd759862-554a-4281-a1ca-93b1a5bc9b3a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:42.606728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55651334-2f9d-47fa-ae45-3480b298052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:42.607614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651334-2f9d-47fa-ae45-3480b298052d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:42.607905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651334-2f9d-47fa-ae45-3480b298052d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:42.608186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55651334-2f9d-47fa-ae45-3480b298052d None admin] PATH_INFO: `/v3/roles/0af0bb9954e74b6c9158c0ea76a2c7a5` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:42.609686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55651334-2f9d-47fa-ae45-3480b298052d None admin] RBAC: Authorizing `identity:get_role(role_id=0af0bb9954e74b6c9158c0ea76a2c7a5)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:42.611053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55651334-2f9d-47fa-ae45-3480b298052d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:42.612425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 555/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:01:42 2022] GET /identity/v3/roles/0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:42.618278 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a7f18-d2e5-4cf3-96b3-478275e8571d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:42.703969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:42.717889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a7f18-d2e5-4cf3-96b3-478275e8571d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:42.751205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7d46b-eb06-4467-aa8c-e8ea98142c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:42.752066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d46b-eb06-4467-aa8c-e8ea98142c70 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:42.752347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d46b-eb06-4467-aa8c-e8ea98142c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:42.752645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d46b-eb06-4467-aa8c-e8ea98142c70 None admin] PATH_INFO: `/v3/users/bfe9d89721f542e3821fcffe851e4a94` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:42.766255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7d46b-eb06-4467-aa8c-e8ea98142c70 None admin] RBAC: Authorizing `identity:get_user(user_id=bfe9d89721f542e3821fcffe851e4a94)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:42.767699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7d46b-eb06-4467-aa8c-e8ea98142c70 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:42.770457 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 559/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:01:42 2022] GET /identity/v3/users/bfe9d89721f542e3821fcffe851e4a94 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:42.776160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55651334-2f9d-47fa-ae45-3480b298052d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:42.848767 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:42.873805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55651334-2f9d-47fa-ae45-3480b298052d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:42.906684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eaf27-6363-44ca-b312-ba89a2b86398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:42.907324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eaf27-6363-44ca-b312-ba89a2b86398 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:42.907615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eaf27-6363-44ca-b312-ba89a2b86398 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:42.907896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eaf27-6363-44ca-b312-ba89a2b86398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:42.974034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87eaf27-6363-44ca-b312-ba89a2b86398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:42.975475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87eaf27-6363-44ca-b312-ba89a2b86398 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:43.047173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:43.071981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 556/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:43.077793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7d46b-eb06-4467-aa8c-e8ea98142c70 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:43.173935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7d46b-eb06-4467-aa8c-e8ea98142c70 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:43.206975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43abdf-e76e-4542-83c9-0ae719cbb9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:43.207960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43abdf-e76e-4542-83c9-0ae719cbb9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:43.208246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43abdf-e76e-4542-83c9-0ae719cbb9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:43.208521 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43abdf-e76e-4542-83c9-0ae719cbb9e4 None admin] PATH_INFO: `/v3/projects/931293ccafe4448292fc1007c2f798f4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:43.209728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43abdf-e76e-4542-83c9-0ae719cbb9e4 None admin] RBAC: Authorizing `identity:get_project(project_id=931293ccafe4448292fc1007c2f798f4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:43.211157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43abdf-e76e-4542-83c9-0ae719cbb9e4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:43.212860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 560/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:01:43 2022] GET /identity/v3/projects/931293ccafe4448292fc1007c2f798f4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:43.218837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eaf27-6363-44ca-b312-ba89a2b86398 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:43.313428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eaf27-6363-44ca-b312-ba89a2b86398 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:43.346732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266188f-a96c-4fff-a9a4-88ea468b0242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:43.347494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266188f-a96c-4fff-a9a4-88ea468b0242 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:43.347780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266188f-a96c-4fff-a9a4-88ea468b0242 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:43.348058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266188f-a96c-4fff-a9a4-88ea468b0242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:43.348913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266188f-a96c-4fff-a9a4-88ea468b0242 None admin] RBAC: Adding query filter params (role.id=0af0bb9954e74b6c9158c0ea76a2c7a5, scope.project.id=931293ccafe4448292fc1007c2f798f4, user.id=bfe9d89721f542e3821fcffe851e4a94) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:43.349229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266188f-a96c-4fff-a9a4-88ea468b0242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:43.350651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266188f-a96c-4fff-a9a4-88ea468b0242 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:43.356267 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 557/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:43 2022] GET /identity/v3/role_assignments?user.id=bfe9d89721f542e3821fcffe851e4a94&scope.project.id=931293ccafe4448292fc1007c2f798f4&role.id=0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:45.339476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3c82-5f1c-49aa-ad4e-907328c489ba None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:45.340030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3c82-5f1c-49aa-ad4e-907328c489ba None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:45.340030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3c82-5f1c-49aa-ad4e-907328c489ba None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:45.341430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 561/1118] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:45.346670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ef6d8-cc7c-4906-9530-0a88f36f103a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:45.347063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ef6d8-cc7c-4906-9530-0a88f36f103a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:45.347444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ef6d8-cc7c-4906-9530-0a88f36f103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:45.364564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4a2ef6d8-cc7c-4906-9530-0a88f36f103a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:45.365781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4a2ef6d8-cc7c-4906-9530-0a88f36f103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:45.394796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:45.431377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 558/1119] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:45.454758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3c82-5f1c-49aa-ad4e-907328c489ba None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:45.470172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:45.554857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3c82-5f1c-49aa-ad4e-907328c489ba None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:45.586990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec5de8-c04d-4ec8-8f4f-9c66e2cc4e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:45.587837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec5de8-c04d-4ec8-8f4f-9c66e2cc4e1c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:45.588121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec5de8-c04d-4ec8-8f4f-9c66e2cc4e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:45.588397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec5de8-c04d-4ec8-8f4f-9c66e2cc4e1c None admin] PATH_INFO: `/v3/roles/0af0bb9954e74b6c9158c0ea76a2c7a5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:45.589940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec5de8-c04d-4ec8-8f4f-9c66e2cc4e1c None admin] RBAC: Authorizing `identity:get_role(role_id=0af0bb9954e74b6c9158c0ea76a2c7a5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:45.591272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec5de8-c04d-4ec8-8f4f-9c66e2cc4e1c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:45.592649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 562/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:01:45 2022] GET /identity/v3/roles/0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:45.599019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ef6d8-cc7c-4906-9530-0a88f36f103a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:45.700068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ef6d8-cc7c-4906-9530-0a88f36f103a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:45.734677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c572f-1905-458c-9cb8-93316be82c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:45.735719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c572f-1905-458c-9cb8-93316be82c7f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:45.736007 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c572f-1905-458c-9cb8-93316be82c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:45.736285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c572f-1905-458c-9cb8-93316be82c7f None admin] PATH_INFO: `/v3/users/bfe9d89721f542e3821fcffe851e4a94` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:45.737493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c572f-1905-458c-9cb8-93316be82c7f None admin] RBAC: Authorizing `identity:get_user(user_id=bfe9d89721f542e3821fcffe851e4a94)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:45.739225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c572f-1905-458c-9cb8-93316be82c7f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:45.740899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 559/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:01:45 2022] GET /identity/v3/users/bfe9d89721f542e3821fcffe851e4a94 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:45.746705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec5de8-c04d-4ec8-8f4f-9c66e2cc4e1c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:45.827707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:45.846781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec5de8-c04d-4ec8-8f4f-9c66e2cc4e1c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:45.884502 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c6000-61bc-4390-b107-a90c9a1083ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:45.885389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c6000-61bc-4390-b107-a90c9a1083ba None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:45.885675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c6000-61bc-4390-b107-a90c9a1083ba None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:45.885953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c6000-61bc-4390-b107-a90c9a1083ba None admin] PATH_INFO: `/v3/projects/931293ccafe4448292fc1007c2f798f4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:45.887129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c6000-61bc-4390-b107-a90c9a1083ba None admin] RBAC: Authorizing `identity:get_project(project_id=931293ccafe4448292fc1007c2f798f4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:45.888574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c6000-61bc-4390-b107-a90c9a1083ba None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:45.890316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 563/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:01:45 2022] GET /identity/v3/projects/931293ccafe4448292fc1007c2f798f4 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:45.896696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c572f-1905-458c-9cb8-93316be82c7f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:45.930964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:46.002751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c572f-1905-458c-9cb8-93316be82c7f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:46.036480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3cf83-e5bc-4b00-a236-8e05894858d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:46.037393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3cf83-e5bc-4b00-a236-8e05894858d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:46.037678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3cf83-e5bc-4b00-a236-8e05894858d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:46.037955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3cf83-e5bc-4b00-a236-8e05894858d3 None admin] PATH_INFO: `/v3/projects/931293ccafe4448292fc1007c2f798f4/users/bfe9d89721f542e3821fcffe851e4a94/roles/0af0bb9954e74b6c9158c0ea76a2c7a5` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:46.040128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3cf83-e5bc-4b00-a236-8e05894858d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=931293ccafe4448292fc1007c2f798f4, user_id=bfe9d89721f542e3821fcffe851e4a94, role_id=0af0bb9954e74b6c9158c0ea76a2c7a5)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:46.041592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3cf83-e5bc-4b00-a236-8e05894858d3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:46.054181 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 560/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:01:45 2022] PUT /identity/v3/projects/931293ccafe4448292fc1007c2f798f4/users/bfe9d89721f542e3821fcffe851e4a94/roles/0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:01:48.042324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c6479-16cd-4ac5-816c-5178e5e7ba9e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.042841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c6479-16cd-4ac5-816c-5178e5e7ba9e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.042841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c6479-16cd-4ac5-816c-5178e5e7ba9e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.044155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 564/1124] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:48.049360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e665b-2d12-440e-a4eb-b353ec70dd8a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.049796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e665b-2d12-440e-a4eb-b353ec70dd8a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.049920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e665b-2d12-440e-a4eb-b353ec70dd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.067628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-652e665b-2d12-440e-a4eb-b353ec70dd8a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:48.068846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-652e665b-2d12-440e-a4eb-b353ec70dd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:48.134096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 561/1125] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:48.158223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c6479-16cd-4ac5-816c-5178e5e7ba9e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:48.257468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c6479-16cd-4ac5-816c-5178e5e7ba9e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:48.290507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c579-8b0e-47fc-ab1e-3f98104213df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:48.291346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c579-8b0e-47fc-ab1e-3f98104213df None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.291626 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c579-8b0e-47fc-ab1e-3f98104213df None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.291906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c579-8b0e-47fc-ab1e-3f98104213df None admin] PATH_INFO: `/v3/roles/0af0bb9954e74b6c9158c0ea76a2c7a5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.293410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28c579-8b0e-47fc-ab1e-3f98104213df None admin] RBAC: Authorizing `identity:get_role(role_id=0af0bb9954e74b6c9158c0ea76a2c7a5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:48.294722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28c579-8b0e-47fc-ab1e-3f98104213df None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:48.296062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 565/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:01:48 2022] GET /identity/v3/roles/0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:48.302587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e665b-2d12-440e-a4eb-b353ec70dd8a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:48.328838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:48.399437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e665b-2d12-440e-a4eb-b353ec70dd8a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:48.432976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4fad-c612-4cab-b2ef-26c4c46fb478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:48.433832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4fad-c612-4cab-b2ef-26c4c46fb478 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.434113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4fad-c612-4cab-b2ef-26c4c46fb478 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.434386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4fad-c612-4cab-b2ef-26c4c46fb478 None admin] PATH_INFO: `/v3/users/bfe9d89721f542e3821fcffe851e4a94` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.435558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a4fad-c612-4cab-b2ef-26c4c46fb478 None admin] RBAC: Authorizing `identity:get_user(user_id=bfe9d89721f542e3821fcffe851e4a94)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:48.437025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a4fad-c612-4cab-b2ef-26c4c46fb478 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:48.438626 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 562/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:01:48 2022] GET /identity/v3/users/bfe9d89721f542e3821fcffe851e4a94 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:48.445121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c579-8b0e-47fc-ab1e-3f98104213df None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:48.464041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:48.542785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c579-8b0e-47fc-ab1e-3f98104213df None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:48.575324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc88f95-8aca-4f21-b02b-bb5743a4f4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:48.575901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc88f95-8aca-4f21-b02b-bb5743a4f4fb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.576183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc88f95-8aca-4f21-b02b-bb5743a4f4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.576457 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc88f95-8aca-4f21-b02b-bb5743a4f4fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.641376 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc88f95-8aca-4f21-b02b-bb5743a4f4fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:48.642834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc88f95-8aca-4f21-b02b-bb5743a4f4fb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:48.660677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:48.739534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 566/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:48.745462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4fad-c612-4cab-b2ef-26c4c46fb478 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:48.835588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:48.842369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4fad-c612-4cab-b2ef-26c4c46fb478 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:48.875447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28aed1-31b9-4c1d-a81f-d9fe33545005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:48.876286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28aed1-31b9-4c1d-a81f-d9fe33545005 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.876572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28aed1-31b9-4c1d-a81f-d9fe33545005 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.876885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28aed1-31b9-4c1d-a81f-d9fe33545005 None admin] PATH_INFO: `/v3/projects/931293ccafe4448292fc1007c2f798f4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.878045 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28aed1-31b9-4c1d-a81f-d9fe33545005 None admin] RBAC: Authorizing `identity:get_project(project_id=931293ccafe4448292fc1007c2f798f4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:48.880239 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28aed1-31b9-4c1d-a81f-d9fe33545005 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:48.881944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 563/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:01:48 2022] GET /identity/v3/projects/931293ccafe4448292fc1007c2f798f4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:48.887889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc88f95-8aca-4f21-b02b-bb5743a4f4fb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:48.984298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc88f95-8aca-4f21-b02b-bb5743a4f4fb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:49.001398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:49.018902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cb074-c07d-4fe9-bfd4-14f5b8bffa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:49.019550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cb074-c07d-4fe9-bfd4-14f5b8bffa70 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:49.019837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cb074-c07d-4fe9-bfd4-14f5b8bffa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:49.020116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cb074-c07d-4fe9-bfd4-14f5b8bffa70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:49.020985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cb074-c07d-4fe9-bfd4-14f5b8bffa70 None admin] RBAC: Adding query filter params (role.id=0af0bb9954e74b6c9158c0ea76a2c7a5, scope.project.id=931293ccafe4448292fc1007c2f798f4, user.id=bfe9d89721f542e3821fcffe851e4a94) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:49.021307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cb074-c07d-4fe9-bfd4-14f5b8bffa70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:49.022743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cb074-c07d-4fe9-bfd4-14f5b8bffa70 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:49.028469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 567/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:48 2022] GET /identity/v3/role_assignments?user.id=bfe9d89721f542e3821fcffe851e4a94&scope.project.id=931293ccafe4448292fc1007c2f798f4&role.id=0af0bb9954e74b6c9158c0ea76a2c7a5 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:51.060097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df368fcd-3752-4814-8110-0b2be479a540 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:51.060651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df368fcd-3752-4814-8110-0b2be479a540 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:51.060651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df368fcd-3752-4814-8110-0b2be479a540 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:51.061987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 564/1131] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:51.067080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86896fb-05c1-4571-beb9-d1a9e0ce672d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:51.067483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86896fb-05c1-4571-beb9-d1a9e0ce672d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:51.067647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86896fb-05c1-4571-beb9-d1a9e0ce672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:51.084517 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e86896fb-05c1-4571-beb9-d1a9e0ce672d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:51.085737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e86896fb-05c1-4571-beb9-d1a9e0ce672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:51.150270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 568/1132] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:51.174232 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df368fcd-3752-4814-8110-0b2be479a540 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:51.272276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df368fcd-3752-4814-8110-0b2be479a540 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:51.305287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005c753-fb1d-4651-944e-0bc9087fb484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:51.306068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005c753-fb1d-4651-944e-0bc9087fb484 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:51.306354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005c753-fb1d-4651-944e-0bc9087fb484 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:51.306632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005c753-fb1d-4651-944e-0bc9087fb484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:51.307790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005c753-fb1d-4651-944e-0bc9087fb484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:51.309263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005c753-fb1d-4651-944e-0bc9087fb484 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:51.310887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 565/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:51.316581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86896fb-05c1-4571-beb9-d1a9e0ce672d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:51.413096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86896fb-05c1-4571-beb9-d1a9e0ce672d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:51.425856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:51.447209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda18920-5e34-4e84-a21e-5e4ee7265567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:51.447867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda18920-5e34-4e84-a21e-5e4ee7265567 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:51.448154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda18920-5e34-4e84-a21e-5e4ee7265567 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:51.448433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda18920-5e34-4e84-a21e-5e4ee7265567 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:51.449179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda18920-5e34-4e84-a21e-5e4ee7265567 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:51.450613 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda18920-5e34-4e84-a21e-5e4ee7265567 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:51.475952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 569/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 06:01:51 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:01:53.522919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c35a-7f79-4934-948f-829aca29c9c9 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:53.523484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c35a-7f79-4934-948f-829aca29c9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:53.523484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c35a-7f79-4934-948f-829aca29c9c9 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:53.524881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 566/1135] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:53.530002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a433-5d1a-45f6-bfe4-aa88a4c6663b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:53.530386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a433-5d1a-45f6-bfe4-aa88a4c6663b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:53.530576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a433-5d1a-45f6-bfe4-aa88a4c6663b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:53.548007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8ed2a433-5d1a-45f6-bfe4-aa88a4c6663b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:53.549219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8ed2a433-5d1a-45f6-bfe4-aa88a4c6663b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:53.614756 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 570/1136] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:01:53.640303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79c35a-7f79-4934-948f-829aca29c9c9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:53.670371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:53.740716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79c35a-7f79-4934-948f-829aca29c9c9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:53.773337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5c74b-e124-40c0-a7d5-e6a5c07a5d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:53.774049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c74b-e124-40c0-a7d5-e6a5c07a5d56 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:53.774330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c74b-e124-40c0-a7d5-e6a5c07a5d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:53.774604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c74b-e124-40c0-a7d5-e6a5c07a5d56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:53.775762 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5c74b-e124-40c0-a7d5-e6a5c07a5d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:53.777231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5c74b-e124-40c0-a7d5-e6a5c07a5d56 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:53.778820 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 567/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:53.785232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2a433-5d1a-45f6-bfe4-aa88a4c6663b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:53.874773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:53.882169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2a433-5d1a-45f6-bfe4-aa88a4c6663b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:53.916227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d863fa-9757-41de-817f-e789c4d91477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:53.916931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d863fa-9757-41de-817f-e789c4d91477 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:53.917223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d863fa-9757-41de-817f-e789c4d91477 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:53.917505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d863fa-9757-41de-817f-e789c4d91477 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:53.918226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d863fa-9757-41de-817f-e789c4d91477 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:53.919664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d863fa-9757-41de-817f-e789c4d91477 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:53.938468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 571/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 06:01:53 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:01:55.996431 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9ce7-6d18-4d4e-be91-93a9e6122058 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:55.996980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9ce7-6d18-4d4e-be91-93a9e6122058 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:55.996980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9ce7-6d18-4d4e-be91-93a9e6122058 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:55.998310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 568/1139] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:56.004339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c47a93-c5d2-4785-9288-38f998b71d14 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:56.004802 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c47a93-c5d2-4785-9288-38f998b71d14 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:56.004957 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c47a93-c5d2-4785-9288-38f998b71d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:56.022187 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-48c47a93-c5d2-4785-9288-38f998b71d14 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:56.023353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-48c47a93-c5d2-4785-9288-38f998b71d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:56.089229 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 572/1140] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:56.114060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9ce7-6d18-4d4e-be91-93a9e6122058 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:56.211854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:56.216759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9ce7-6d18-4d4e-be91-93a9e6122058 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:56.250810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9dff1-2d19-4567-bdc1-0455ebda4500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:56.251529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9dff1-2d19-4567-bdc1-0455ebda4500 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:56.251819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9dff1-2d19-4567-bdc1-0455ebda4500 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:56.252093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9dff1-2d19-4567-bdc1-0455ebda4500 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:56.262298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9dff1-2d19-4567-bdc1-0455ebda4500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-63e9dff1-2d19-4567-bdc1-0455ebda4500 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:56.270341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:56.271551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:56.272505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 569/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:56.277557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c47a93-c5d2-4785-9288-38f998b71d14 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:56.356368 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:56.375625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c47a93-c5d2-4785-9288-38f998b71d14 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:56.408433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d631fc1-a702-4fd4-b4fb-6f56fb0a59a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:56.409136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d631fc1-a702-4fd4-b4fb-6f56fb0a59a6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:56.410282 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d631fc1-a702-4fd4-b4fb-6f56fb0a59a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:56.410562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d631fc1-a702-4fd4-b4fb-6f56fb0a59a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:56.411313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d631fc1-a702-4fd4-b4fb-6f56fb0a59a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:56.411622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d631fc1-a702-4fd4-b4fb-6f56fb0a59a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:56.413036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d631fc1-a702-4fd4-b4fb-6f56fb0a59a6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:56.420878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 573/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:01:56.426569 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9dff1-2d19-4567-bdc1-0455ebda4500 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:56.525462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9dff1-2d19-4567-bdc1-0455ebda4500 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:56.558396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850360e2-578e-4e27-95c1-b38fa7d2ed1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:56.559254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850360e2-578e-4e27-95c1-b38fa7d2ed1f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:56.559537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850360e2-578e-4e27-95c1-b38fa7d2ed1f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:56.559813 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850360e2-578e-4e27-95c1-b38fa7d2ed1f None admin] PATH_INFO: `/v3/users/9e9af46b32294b749c20150f29dc53fa` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:56.572529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850360e2-578e-4e27-95c1-b38fa7d2ed1f None admin] RBAC: Authorizing `identity:get_user(user_id=9e9af46b32294b749c20150f29dc53fa)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:56.574001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850360e2-578e-4e27-95c1-b38fa7d2ed1f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:56.575619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 570/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:01:56 2022] GET /identity/v3/users/9e9af46b32294b749c20150f29dc53fa => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:56.581967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d631fc1-a702-4fd4-b4fb-6f56fb0a59a6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:56.681903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d631fc1-a702-4fd4-b4fb-6f56fb0a59a6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:56.715135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bbe77-6863-42c9-9dc8-7ca291214ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:56.715785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bbe77-6863-42c9-9dc8-7ca291214ccb None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:56.716074 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bbe77-6863-42c9-9dc8-7ca291214ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:56.716354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bbe77-6863-42c9-9dc8-7ca291214ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:56.728089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:56.785530 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bbe77-6863-42c9-9dc8-7ca291214ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:56.786915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bbe77-6863-42c9-9dc8-7ca291214ccb None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:56.882637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 574/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:01:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:01:56.888496 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850360e2-578e-4e27-95c1-b38fa7d2ed1f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:56.906653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:56.988191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850360e2-578e-4e27-95c1-b38fa7d2ed1f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:57.020324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d25a9e-2ebf-4c74-81d3-034a668136a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:57.021198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d25a9e-2ebf-4c74-81d3-034a668136a5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:57.021481 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d25a9e-2ebf-4c74-81d3-034a668136a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:57.021758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d25a9e-2ebf-4c74-81d3-034a668136a5 None admin] PATH_INFO: `/v3/projects/b8553a7668604e1daffdce9b8a934e8c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:57.022931 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d25a9e-2ebf-4c74-81d3-034a668136a5 None admin] RBAC: Authorizing `identity:get_project(project_id=b8553a7668604e1daffdce9b8a934e8c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:57.024355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d25a9e-2ebf-4c74-81d3-034a668136a5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:57.026054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 571/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:01:56 2022] GET /identity/v3/projects/b8553a7668604e1daffdce9b8a934e8c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:57.032209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bbe77-6863-42c9-9dc8-7ca291214ccb None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:57.074945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:57.130670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bbe77-6863-42c9-9dc8-7ca291214ccb None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:57.163993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebce49-0871-4b5b-a5dd-d359755b32fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:57.164647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebce49-0871-4b5b-a5dd-d359755b32fe None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:57.164933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebce49-0871-4b5b-a5dd-d359755b32fe None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:57.165205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebce49-0871-4b5b-a5dd-d359755b32fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:57.166021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebce49-0871-4b5b-a5dd-d359755b32fe None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=b8553a7668604e1daffdce9b8a934e8c, user.id=9e9af46b32294b749c20150f29dc53fa) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:57.166330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebce49-0871-4b5b-a5dd-d359755b32fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:57.167748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebce49-0871-4b5b-a5dd-d359755b32fe None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:57.173044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 575/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:01:57 2022] GET /identity/v3/role_assignments?user.id=9e9af46b32294b749c20150f29dc53fa&scope.project.id=b8553a7668604e1daffdce9b8a934e8c&role.id=efc16976111d431c9173186cbd0e6c24 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:59.154234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b8b46-e641-4611-9ecf-39378493120e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:59.154770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b8b46-e641-4611-9ecf-39378493120e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:59.154770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b8b46-e641-4611-9ecf-39378493120e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:59.156162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 572/1147] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:59.162133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71485e4d-7199-4381-83fb-34b087f28248 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:59.162534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71485e4d-7199-4381-83fb-34b087f28248 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:59.162688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71485e4d-7199-4381-83fb-34b087f28248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:59.179758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-71485e4d-7199-4381-83fb-34b087f28248 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:59.180985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-71485e4d-7199-4381-83fb-34b087f28248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:59.255743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 576/1148] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 06:01:59.278718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b8b46-e641-4611-9ecf-39378493120e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:59.362296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:59.378759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b8b46-e641-4611-9ecf-39378493120e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:59.412754 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f1fb0-3033-42b2-b50f-c31ab3fab28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:59.413483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1fb0-3033-42b2-b50f-c31ab3fab28d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:59.413768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1fb0-3033-42b2-b50f-c31ab3fab28d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:59.414042 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f1fb0-3033-42b2-b50f-c31ab3fab28d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:59.423809 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f1fb0-3033-42b2-b50f-c31ab3fab28d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-d51f1fb0-3033-42b2-b50f-c31ab3fab28d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:01:59.431591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:01:59.432709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:01:59.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 573/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:01:59.438799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71485e4d-7199-4381-83fb-34b087f28248 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:59.473271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:59.541438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71485e4d-7199-4381-83fb-34b087f28248 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:59.588832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e357f-0095-423e-ba8a-60a219e731e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:59.589494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e357f-0095-423e-ba8a-60a219e731e3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:59.589777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e357f-0095-423e-ba8a-60a219e731e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:59.590047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e357f-0095-423e-ba8a-60a219e731e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:59.590794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e357f-0095-423e-ba8a-60a219e731e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:01:59.591099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e357f-0095-423e-ba8a-60a219e731e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:59.592467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e357f-0095-423e-ba8a-60a219e731e3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:59.601348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 577/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:01:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:59.607123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f1fb0-3033-42b2-b50f-c31ab3fab28d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:59.704864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f1fb0-3033-42b2-b50f-c31ab3fab28d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:59.737023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f48841-919f-40e4-88ad-7371ef8ef89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:59.737916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f48841-919f-40e4-88ad-7371ef8ef89e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:59.738200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f48841-919f-40e4-88ad-7371ef8ef89e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:59.738475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f48841-919f-40e4-88ad-7371ef8ef89e None admin] PATH_INFO: `/v3/users/9e9af46b32294b749c20150f29dc53fa` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:59.739654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f48841-919f-40e4-88ad-7371ef8ef89e None admin] RBAC: Authorizing `identity:get_user(user_id=9e9af46b32294b749c20150f29dc53fa)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:59.741119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f48841-919f-40e4-88ad-7371ef8ef89e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:59.742734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 574/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:01:59 2022] GET /identity/v3/users/9e9af46b32294b749c20150f29dc53fa => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:59.748498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e357f-0095-423e-ba8a-60a219e731e3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:59.843242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:59.846863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e357f-0095-423e-ba8a-60a219e731e3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:59.880526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1e9db-aaf3-4964-8aca-5ea59c3b2566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:59.881419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e9db-aaf3-4964-8aca-5ea59c3b2566 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:59.881705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e9db-aaf3-4964-8aca-5ea59c3b2566 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:59.881980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e9db-aaf3-4964-8aca-5ea59c3b2566 None admin] PATH_INFO: `/v3/projects/b8553a7668604e1daffdce9b8a934e8c` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:59.883155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1e9db-aaf3-4964-8aca-5ea59c3b2566 None admin] RBAC: Authorizing `identity:get_project(project_id=b8553a7668604e1daffdce9b8a934e8c)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:59.884600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1e9db-aaf3-4964-8aca-5ea59c3b2566 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:59.886328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 578/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:01:59 2022] GET /identity/v3/projects/b8553a7668604e1daffdce9b8a934e8c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:01:59.892326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f48841-919f-40e4-88ad-7371ef8ef89e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:59.907829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:59.990337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f48841-919f-40e4-88ad-7371ef8ef89e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:00.023494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab9559-ac59-4ed6-8b47-77f204b103d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:00.024366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab9559-ac59-4ed6-8b47-77f204b103d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:00.024686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab9559-ac59-4ed6-8b47-77f204b103d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:00.024968 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab9559-ac59-4ed6-8b47-77f204b103d1 None admin] PATH_INFO: `/v3/projects/b8553a7668604e1daffdce9b8a934e8c/users/9e9af46b32294b749c20150f29dc53fa/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:00.026905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab9559-ac59-4ed6-8b47-77f204b103d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8553a7668604e1daffdce9b8a934e8c, user_id=9e9af46b32294b749c20150f29dc53fa, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:00.028337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab9559-ac59-4ed6-8b47-77f204b103d1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:00.040905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 575/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:01:59 2022] PUT /identity/v3/projects/b8553a7668604e1daffdce9b8a934e8c/users/9e9af46b32294b749c20150f29dc53fa/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:02:02.054228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0dfa7-c44d-4a96-a614-0cef6fda6eb8 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:02.054752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0dfa7-c44d-4a96-a614-0cef6fda6eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:02.054752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0dfa7-c44d-4a96-a614-0cef6fda6eb8 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:02.056092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 579/1154] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:02.061375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27306-32d6-4b21-8add-0dc836916122 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:02.061815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27306-32d6-4b21-8add-0dc836916122 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:02.061927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27306-32d6-4b21-8add-0dc836916122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:02.078860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b3b27306-32d6-4b21-8add-0dc836916122 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:02.080040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b3b27306-32d6-4b21-8add-0dc836916122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:02.146117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 576/1155] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:02:02.169955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0dfa7-c44d-4a96-a614-0cef6fda6eb8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:02.269379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0dfa7-c44d-4a96-a614-0cef6fda6eb8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:02.302811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afe330-0fce-43bf-8c0a-eff778a3afa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:02.303590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afe330-0fce-43bf-8c0a-eff778a3afa7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:02.303876 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afe330-0fce-43bf-8c0a-eff778a3afa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:02.304153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afe330-0fce-43bf-8c0a-eff778a3afa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:02.314036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afe330-0fce-43bf-8c0a-eff778a3afa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-00afe330-0fce-43bf-8c0a-eff778a3afa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:02:02.322169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:02:02.323306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:02:02.324292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 580/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:02:02.329155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27306-32d6-4b21-8add-0dc836916122 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:02.331326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:02.427632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27306-32d6-4b21-8add-0dc836916122 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:02.460213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad3c14-fab4-4e20-acee-652771c2b538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:02.460896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad3c14-fab4-4e20-acee-652771c2b538 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:02.461185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad3c14-fab4-4e20-acee-652771c2b538 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:02.461464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad3c14-fab4-4e20-acee-652771c2b538 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:02.462206 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad3c14-fab4-4e20-acee-652771c2b538 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:02:02.462515 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad3c14-fab4-4e20-acee-652771c2b538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:02.463891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad3c14-fab4-4e20-acee-652771c2b538 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:02.471644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 577/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:02:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:02.477690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afe330-0fce-43bf-8c0a-eff778a3afa7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:02.506847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:02.578414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afe330-0fce-43bf-8c0a-eff778a3afa7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:02.610432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf9f34-b665-4804-8e0b-dac39743793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:02.611289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9f34-b665-4804-8e0b-dac39743793f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:02.611572 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9f34-b665-4804-8e0b-dac39743793f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:02.611848 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9f34-b665-4804-8e0b-dac39743793f None admin] PATH_INFO: `/v3/users/9e9af46b32294b749c20150f29dc53fa` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:02.613982 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf9f34-b665-4804-8e0b-dac39743793f None admin] RBAC: Authorizing `identity:get_user(user_id=9e9af46b32294b749c20150f29dc53fa)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:02.615423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf9f34-b665-4804-8e0b-dac39743793f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:02.617073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 581/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:02:02 2022] GET /identity/v3/users/9e9af46b32294b749c20150f29dc53fa => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:02.623109 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad3c14-fab4-4e20-acee-652771c2b538 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:02.684547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:02.723465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad3c14-fab4-4e20-acee-652771c2b538 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:02.756658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6994d5c-56e6-446d-a065-1d434e447f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:02.757295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6994d5c-56e6-446d-a065-1d434e447f2d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:02.757581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6994d5c-56e6-446d-a065-1d434e447f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:02.757859 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6994d5c-56e6-446d-a065-1d434e447f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:02.822915 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6994d5c-56e6-446d-a065-1d434e447f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:02.824346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6994d5c-56e6-446d-a065-1d434e447f2d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:02.883088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:02.920880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 578/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:02:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 06:02:02.927184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf9f34-b665-4804-8e0b-dac39743793f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:03.021177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:03.028258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf9f34-b665-4804-8e0b-dac39743793f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:03.061714 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d5e35-b480-4ad4-a8c8-365a7b62c1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:03.062564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d5e35-b480-4ad4-a8c8-365a7b62c1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:03.062850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d5e35-b480-4ad4-a8c8-365a7b62c1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:03.063127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d5e35-b480-4ad4-a8c8-365a7b62c1c6 None admin] PATH_INFO: `/v3/projects/b8553a7668604e1daffdce9b8a934e8c` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:03.064293 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d5e35-b480-4ad4-a8c8-365a7b62c1c6 None admin] RBAC: Authorizing `identity:get_project(project_id=b8553a7668604e1daffdce9b8a934e8c)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:03.065939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d5e35-b480-4ad4-a8c8-365a7b62c1c6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:03.067622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 582/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:02:02 2022] GET /identity/v3/projects/b8553a7668604e1daffdce9b8a934e8c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:03.073574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6994d5c-56e6-446d-a065-1d434e447f2d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:03.169713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6994d5c-56e6-446d-a065-1d434e447f2d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:03.201848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919180b8-360b-4686-a25a-69b44c8e4acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:03.202484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919180b8-360b-4686-a25a-69b44c8e4acf None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:03.202769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919180b8-360b-4686-a25a-69b44c8e4acf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:03.203045 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919180b8-360b-4686-a25a-69b44c8e4acf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:03.203875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919180b8-360b-4686-a25a-69b44c8e4acf None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=b8553a7668604e1daffdce9b8a934e8c, user.id=9e9af46b32294b749c20150f29dc53fa) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:02:03.204189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919180b8-360b-4686-a25a-69b44c8e4acf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:03.205631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919180b8-360b-4686-a25a-69b44c8e4acf None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:03.211989 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 579/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:02:03 2022] GET /identity/v3/role_assignments?user.id=9e9af46b32294b749c20150f29dc53fa&scope.project.id=b8553a7668604e1daffdce9b8a934e8c&role.id=efc16976111d431c9173186cbd0e6c24 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:05.224709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b547bb0-dd8e-4a73-8276-e30443aa034c None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:05.225242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b547bb0-dd8e-4a73-8276-e30443aa034c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:05.225242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b547bb0-dd8e-4a73-8276-e30443aa034c None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:05.226625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 583/1162] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:05.231797 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed947838-58bf-4430-9cd6-b05703ac1ab5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:05.232184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed947838-58bf-4430-9cd6-b05703ac1ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:05.232365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed947838-58bf-4430-9cd6-b05703ac1ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:05.248780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ed947838-58bf-4430-9cd6-b05703ac1ab5 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:05.249959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ed947838-58bf-4430-9cd6-b05703ac1ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:05.273366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:05.317183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 580/1163] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:02:05.339567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b547bb0-dd8e-4a73-8276-e30443aa034c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:05.438242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b547bb0-dd8e-4a73-8276-e30443aa034c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:05.471160 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472c491-b858-48c1-8ee3-1817f252e0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:05.471898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472c491-b858-48c1-8ee3-1817f252e0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:05.472185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472c491-b858-48c1-8ee3-1817f252e0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:05.472510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472c491-b858-48c1-8ee3-1817f252e0c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:05.501253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:05.539314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472c491-b858-48c1-8ee3-1817f252e0c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:05.540815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472c491-b858-48c1-8ee3-1817f252e0c4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:05.638086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 584/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:02:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:02:05.644065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed947838-58bf-4430-9cd6-b05703ac1ab5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:05.740635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed947838-58bf-4430-9cd6-b05703ac1ab5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:05.773117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbe900-ac0b-4774-a581-951066d1abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:05.773844 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe900-ac0b-4774-a581-951066d1abfa None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:05.774132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe900-ac0b-4774-a581-951066d1abfa None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:05.774414 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe900-ac0b-4774-a581-951066d1abfa None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:05.780904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbe900-ac0b-4774-a581-951066d1abfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:05.782345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbe900-ac0b-4774-a581-951066d1abfa None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-a1cbe900-ac0b-4774-a581-951066d1abfa None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:02:05.797044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:02:05.798091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:02:05.799202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 581/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jun 20 06:02:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:02:05.804154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472c491-b858-48c1-8ee3-1817f252e0c4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:05.864794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:05.904434 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472c491-b858-48c1-8ee3-1817f252e0c4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:05.936913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11708340-9cf3-498f-b0a0-bba4eb8fcaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:05.937567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11708340-9cf3-498f-b0a0-bba4eb8fcaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:05.937850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11708340-9cf3-498f-b0a0-bba4eb8fcaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:05.938126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11708340-9cf3-498f-b0a0-bba4eb8fcaf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:05.938843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11708340-9cf3-498f-b0a0-bba4eb8fcaf5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:02:05.939153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11708340-9cf3-498f-b0a0-bba4eb8fcaf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:05.941138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11708340-9cf3-498f-b0a0-bba4eb8fcaf5 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:05.948153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 585/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jun 20 06:02:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:07.941098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f307cd-8d6b-4d94-bc7e-bcc69f42b697 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:07.941602 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f307cd-8d6b-4d94-bc7e-bcc69f42b697 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:07.941602 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f307cd-8d6b-4d94-bc7e-bcc69f42b697 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:07.942947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 582/1167] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:07.948966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6e2a3-677b-494d-9712-a6dab64f7186 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:07.949365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6e2a3-677b-494d-9712-a6dab64f7186 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:07.949523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6e2a3-677b-494d-9712-a6dab64f7186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:07.966562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ffa6e2a3-677b-494d-9712-a6dab64f7186 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:07.967727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ffa6e2a3-677b-494d-9712-a6dab64f7186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:08.035781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 586/1168] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:02:08.059307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f307cd-8d6b-4d94-bc7e-bcc69f42b697 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:08.078476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:08.163164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f307cd-8d6b-4d94-bc7e-bcc69f42b697 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:08.195981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087512d6-805a-4504-807c-4c4d27f94fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:08.196578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087512d6-805a-4504-807c-4c4d27f94fdb None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:08.196899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087512d6-805a-4504-807c-4c4d27f94fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:08.197180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087512d6-805a-4504-807c-4c4d27f94fdb None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:08.197929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087512d6-805a-4504-807c-4c4d27f94fdb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:08.199292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087512d6-805a-4504-807c-4c4d27f94fdb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:08.213385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 583/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Mon Jun 20 06:02:08 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:02:10.233969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f1ba8-a7ad-4046-a055-cc9812586aea None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:10.234531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f1ba8-a7ad-4046-a055-cc9812586aea None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:10.234531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f1ba8-a7ad-4046-a055-cc9812586aea None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:10.235909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 587/1170] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:10.241781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65799a9-3bbc-41fb-ba87-a44fa7c12f7b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:10.242182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65799a9-3bbc-41fb-ba87-a44fa7c12f7b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:10.242346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65799a9-3bbc-41fb-ba87-a44fa7c12f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:10.258922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d65799a9-3bbc-41fb-ba87-a44fa7c12f7b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:10.260114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d65799a9-3bbc-41fb-ba87-a44fa7c12f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:10.325154 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 584/1171] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:02:10.349150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f1ba8-a7ad-4046-a055-cc9812586aea None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:10.405895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:10.449985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f1ba8-a7ad-4046-a055-cc9812586aea None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:10.482708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98930-91be-4e02-85e0-72d8768dc539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:10.483587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98930-91be-4e02-85e0-72d8768dc539 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:10.483872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98930-91be-4e02-85e0-72d8768dc539 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:10.484195 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98930-91be-4e02-85e0-72d8768dc539 None admin] PATH_INFO: `/v3/domains/d358a6f5378c46158daa93478a5edfeb` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:10.494874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db98930-91be-4e02-85e0-72d8768dc539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d358a6f5378c46158daa93478a5edfeb)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:10.496353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db98930-91be-4e02-85e0-72d8768dc539 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:10.497990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 588/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Mon Jun 20 06:02:10 2022] GET /identity/v3/domains/d358a6f5378c46158daa93478a5edfeb => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:10.503731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65799a9-3bbc-41fb-ba87-a44fa7c12f7b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:10.513630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:10.607498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65799a9-3bbc-41fb-ba87-a44fa7c12f7b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:10.640676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44e5df-acfc-4edf-965c-f8955da657aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:10.641339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44e5df-acfc-4edf-965c-f8955da657aa None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:10.641624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44e5df-acfc-4edf-965c-f8955da657aa None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:10.641902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44e5df-acfc-4edf-965c-f8955da657aa None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:10.642634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44e5df-acfc-4edf-965c-f8955da657aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:10.644589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44e5df-acfc-4edf-965c-f8955da657aa None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:10.672391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 585/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 06:02:10 2022] POST /identity/v3/projects => generated 361 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:02:12.729454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79078-f420-4363-8134-1752f384789a None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:12.730032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79078-f420-4363-8134-1752f384789a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:12.730032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79078-f420-4363-8134-1752f384789a None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:12.731375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 589/1174] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:12.736633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9d883-1559-4105-bd31-f9f73b25b295 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:12.737078 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9d883-1559-4105-bd31-f9f73b25b295 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:12.737376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9d883-1559-4105-bd31-f9f73b25b295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:12.754315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-eaa9d883-1559-4105-bd31-f9f73b25b295 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:12.755494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-eaa9d883-1559-4105-bd31-f9f73b25b295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:12.810648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:12.822973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 586/1175] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:02:12.847394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b79078-f420-4363-8134-1752f384789a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:12.946620 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b79078-f420-4363-8134-1752f384789a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:12.962427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:12.979331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3534a2-b16c-4522-9b86-e3b8adcd6bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:12.980181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3534a2-b16c-4522-9b86-e3b8adcd6bbc None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:12.980460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3534a2-b16c-4522-9b86-e3b8adcd6bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:12.980762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3534a2-b16c-4522-9b86-e3b8adcd6bbc None admin] PATH_INFO: `/v3/domains/d358a6f5378c46158daa93478a5edfeb` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:12.981919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3534a2-b16c-4522-9b86-e3b8adcd6bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=d358a6f5378c46158daa93478a5edfeb)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:12.983351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3534a2-b16c-4522-9b86-e3b8adcd6bbc None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:12.984985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 590/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Mon Jun 20 06:02:12 2022] GET /identity/v3/domains/d358a6f5378c46158daa93478a5edfeb => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:12.991186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9d883-1559-4105-bd31-f9f73b25b295 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:13.087758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9d883-1559-4105-bd31-f9f73b25b295 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:13.120981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73d43f-5c2d-407e-94b3-0fbdc01dc595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:13.121632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73d43f-5c2d-407e-94b3-0fbdc01dc595 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:13.121919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73d43f-5c2d-407e-94b3-0fbdc01dc595 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:13.122197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73d43f-5c2d-407e-94b3-0fbdc01dc595 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:13.122894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73d43f-5c2d-407e-94b3-0fbdc01dc595 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:13.124316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73d43f-5c2d-407e-94b3-0fbdc01dc595 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:13.143488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 587/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 06:02:12 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:02:15.242204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78cb22-eba7-4375-a3e4-ca25420d0a1c None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:15.242754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78cb22-eba7-4375-a3e4-ca25420d0a1c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:15.242754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78cb22-eba7-4375-a3e4-ca25420d0a1c None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:15.244146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 591/1178] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:15.249447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d97f89-401b-4fe3-9267-7b2d608074c4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:15.249856 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d97f89-401b-4fe3-9267-7b2d608074c4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:15.250008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d97f89-401b-4fe3-9267-7b2d608074c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:15.266915 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f5d97f89-401b-4fe3-9267-7b2d608074c4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:15.268080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f5d97f89-401b-4fe3-9267-7b2d608074c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:15.308562 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:15.333846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 588/1179] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:02:15.357765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78cb22-eba7-4375-a3e4-ca25420d0a1c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:15.458378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78cb22-eba7-4375-a3e4-ca25420d0a1c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:15.491543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65457fe-4082-483e-9680-df8761d95b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:15.492362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65457fe-4082-483e-9680-df8761d95b89 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:15.492597 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65457fe-4082-483e-9680-df8761d95b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:15.492900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65457fe-4082-483e-9680-df8761d95b89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:15.502614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65457fe-4082-483e-9680-df8761d95b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-c65457fe-4082-483e-9680-df8761d95b89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:02:15.510262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:02:15.511437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:02:15.512575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 592/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:02:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:02:15.517408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d97f89-401b-4fe3-9267-7b2d608074c4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:15.615172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d97f89-401b-4fe3-9267-7b2d608074c4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:15.649611 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfad73-97d5-41e8-9dec-e4c6c2961985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:15.650289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfad73-97d5-41e8-9dec-e4c6c2961985 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:15.650555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfad73-97d5-41e8-9dec-e4c6c2961985 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:15.650831 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfad73-97d5-41e8-9dec-e4c6c2961985 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:15.651568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfad73-97d5-41e8-9dec-e4c6c2961985 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:02:15.651877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfad73-97d5-41e8-9dec-e4c6c2961985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:15.653284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfad73-97d5-41e8-9dec-e4c6c2961985 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:15.662283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 589/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:02:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:02:15.668067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65457fe-4082-483e-9680-df8761d95b89 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:15.713032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:15.767436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65457fe-4082-483e-9680-df8761d95b89 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:15.801083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeab9a9-44e9-45fc-8cad-8f2f3087754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:15.801936 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab9a9-44e9-45fc-8cad-8f2f3087754e None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:15.802224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab9a9-44e9-45fc-8cad-8f2f3087754e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:15.802505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeab9a9-44e9-45fc-8cad-8f2f3087754e None admin] PATH_INFO: `/v3/users/b3536952e7ad4b33a8c1350ac371981e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:15.815162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeab9a9-44e9-45fc-8cad-8f2f3087754e None admin] RBAC: Authorizing `identity:get_user(user_id=b3536952e7ad4b33a8c1350ac371981e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:15.816665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeab9a9-44e9-45fc-8cad-8f2f3087754e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:15.818289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 593/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:02:15 2022] GET /identity/v3/users/b3536952e7ad4b33a8c1350ac371981e => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:15.823903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfad73-97d5-41e8-9dec-e4c6c2961985 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:15.864338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:15.923070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfad73-97d5-41e8-9dec-e4c6c2961985 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:15.955763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729a6fa-ca3a-4010-94d3-41b84289ed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:15.956978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729a6fa-ca3a-4010-94d3-41b84289ed99 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:15.957260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729a6fa-ca3a-4010-94d3-41b84289ed99 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:15.957539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729a6fa-ca3a-4010-94d3-41b84289ed99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:16.021955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729a6fa-ca3a-4010-94d3-41b84289ed99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:16.023330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729a6fa-ca3a-4010-94d3-41b84289ed99 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:16.059998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:16.118273 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 590/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:02:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:02:16.124067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeab9a9-44e9-45fc-8cad-8f2f3087754e None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:16.220403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeab9a9-44e9-45fc-8cad-8f2f3087754e None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:16.222703 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:16.258704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c28116-1ef8-4ae5-ab43-1ca871cca31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:16.259566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c28116-1ef8-4ae5-ab43-1ca871cca31b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:16.259851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c28116-1ef8-4ae5-ab43-1ca871cca31b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:16.260129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c28116-1ef8-4ae5-ab43-1ca871cca31b None admin] PATH_INFO: `/v3/projects/c321b6322e4f4e8fbc1a54f428b0025c` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:16.261313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c28116-1ef8-4ae5-ab43-1ca871cca31b None admin] RBAC: Authorizing `identity:get_project(project_id=c321b6322e4f4e8fbc1a54f428b0025c)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:16.262761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c28116-1ef8-4ae5-ab43-1ca871cca31b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:16.264457 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 594/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:02:16 2022] GET /identity/v3/projects/c321b6322e4f4e8fbc1a54f428b0025c => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:16.270877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729a6fa-ca3a-4010-94d3-41b84289ed99 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:16.368296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729a6fa-ca3a-4010-94d3-41b84289ed99 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:16.400523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421e749-d602-436e-8632-a507708451fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:16.401192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421e749-d602-436e-8632-a507708451fc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:16.401478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421e749-d602-436e-8632-a507708451fc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:16.401757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421e749-d602-436e-8632-a507708451fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:16.402583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421e749-d602-436e-8632-a507708451fc None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=c321b6322e4f4e8fbc1a54f428b0025c, user.id=b3536952e7ad4b33a8c1350ac371981e) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:02:16.402900 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421e749-d602-436e-8632-a507708451fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:16.404313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421e749-d602-436e-8632-a507708451fc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:16.410511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 591/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:02:16 2022] GET /identity/v3/role_assignments?user.id=b3536952e7ad4b33a8c1350ac371981e&scope.project.id=c321b6322e4f4e8fbc1a54f428b0025c&role.id=efc16976111d431c9173186cbd0e6c24 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:18.555336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca59871-a86e-4b46-a4ed-76d21418c001 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:18.555864 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca59871-a86e-4b46-a4ed-76d21418c001 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:18.555986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca59871-a86e-4b46-a4ed-76d21418c001 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:18.557302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 595/1186] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:18.562800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b8811-171d-4ddc-a9a5-223cb3c46591 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:18.563236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b8811-171d-4ddc-a9a5-223cb3c46591 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:18.563363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b8811-171d-4ddc-a9a5-223cb3c46591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:18.569179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:18.582229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0a5b8811-171d-4ddc-a9a5-223cb3c46591 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:18.583400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0a5b8811-171d-4ddc-a9a5-223cb3c46591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:18.649425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 592/1187] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:02:18.672644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca59871-a86e-4b46-a4ed-76d21418c001 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:18.770888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca59871-a86e-4b46-a4ed-76d21418c001 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:18.803752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569f974-5272-4df6-8b08-df668e181262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:18.804519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569f974-5272-4df6-8b08-df668e181262 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:18.804829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569f974-5272-4df6-8b08-df668e181262 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:18.805101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569f974-5272-4df6-8b08-df668e181262 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:18.814884 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569f974-5272-4df6-8b08-df668e181262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-5569f974-5272-4df6-8b08-df668e181262 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:02:18.822614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:02:18.823752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:02:18.824841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 596/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:02:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:02:18.830000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b8811-171d-4ddc-a9a5-223cb3c46591 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:18.926574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b8811-171d-4ddc-a9a5-223cb3c46591 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:18.954282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:18.960112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec02ca-ffda-405a-9ad0-a76acea9a2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:18.960803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec02ca-ffda-405a-9ad0-a76acea9a2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:18.961093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec02ca-ffda-405a-9ad0-a76acea9a2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:18.961371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec02ca-ffda-405a-9ad0-a76acea9a2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:18.962113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec02ca-ffda-405a-9ad0-a76acea9a2d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:02:18.962421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec02ca-ffda-405a-9ad0-a76acea9a2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:18.963790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec02ca-ffda-405a-9ad0-a76acea9a2d0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:18.972461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 593/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:02:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:18.978317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569f974-5272-4df6-8b08-df668e181262 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:19.008719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:19.077182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569f974-5272-4df6-8b08-df668e181262 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:19.110289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891333c5-1a1f-4fff-b443-55e10a381e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:19.111150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891333c5-1a1f-4fff-b443-55e10a381e2f None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:19.111435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891333c5-1a1f-4fff-b443-55e10a381e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:19.111712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891333c5-1a1f-4fff-b443-55e10a381e2f None admin] PATH_INFO: `/v3/users/b3536952e7ad4b33a8c1350ac371981e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:19.113413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891333c5-1a1f-4fff-b443-55e10a381e2f None admin] RBAC: Authorizing `identity:get_user(user_id=b3536952e7ad4b33a8c1350ac371981e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:19.114860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891333c5-1a1f-4fff-b443-55e10a381e2f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:19.116470 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 597/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:02:18 2022] GET /identity/v3/users/b3536952e7ad4b33a8c1350ac371981e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:19.122105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec02ca-ffda-405a-9ad0-a76acea9a2d0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:19.219729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec02ca-ffda-405a-9ad0-a76acea9a2d0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:19.251480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e9009-1de9-428f-974d-a528785b59e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:19.252322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9009-1de9-428f-974d-a528785b59e3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:19.252598 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9009-1de9-428f-974d-a528785b59e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:19.253855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9009-1de9-428f-974d-a528785b59e3 None admin] PATH_INFO: `/v3/projects/c321b6322e4f4e8fbc1a54f428b0025c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:19.255026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e9009-1de9-428f-974d-a528785b59e3 None admin] RBAC: Authorizing `identity:get_project(project_id=c321b6322e4f4e8fbc1a54f428b0025c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:19.256458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e9009-1de9-428f-974d-a528785b59e3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:19.258183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 594/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:02:19 2022] GET /identity/v3/projects/c321b6322e4f4e8fbc1a54f428b0025c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:19.263849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891333c5-1a1f-4fff-b443-55e10a381e2f None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:19.364468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:19.368390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891333c5-1a1f-4fff-b443-55e10a381e2f None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:19.401745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cd755-0423-4a8c-8ac4-759bc1b3688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:19.402632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cd755-0423-4a8c-8ac4-759bc1b3688f None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:19.402916 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cd755-0423-4a8c-8ac4-759bc1b3688f None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:19.403190 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cd755-0423-4a8c-8ac4-759bc1b3688f None admin] PATH_INFO: `/v3/projects/c321b6322e4f4e8fbc1a54f428b0025c/users/b3536952e7ad4b33a8c1350ac371981e/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:19.405152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cd755-0423-4a8c-8ac4-759bc1b3688f None admin] RBAC: Authorizing `identity:create_grant(project_id=c321b6322e4f4e8fbc1a54f428b0025c, user_id=b3536952e7ad4b33a8c1350ac371981e, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:19.406587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cd755-0423-4a8c-8ac4-759bc1b3688f None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:19.418744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 598/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:02:19 2022] PUT /identity/v3/projects/c321b6322e4f4e8fbc1a54f428b0025c/users/b3536952e7ad4b33a8c1350ac371981e/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:02:21.423443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc9a9b-af50-4d3f-aa58-817943e60f32 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:21.423974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc9a9b-af50-4d3f-aa58-817943e60f32 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:21.423974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc9a9b-af50-4d3f-aa58-817943e60f32 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:21.426018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 595/1193] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:21.431204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30381-c99d-411d-bea7-721e1ea096cf None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:21.431631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30381-c99d-411d-bea7-721e1ea096cf None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:21.431769 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30381-c99d-411d-bea7-721e1ea096cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:21.449100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2da30381-c99d-411d-bea7-721e1ea096cf None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:21.450275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2da30381-c99d-411d-bea7-721e1ea096cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:21.515051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 599/1194] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:02:21.539210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc9a9b-af50-4d3f-aa58-817943e60f32 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:21.600690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:21.642097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc9a9b-af50-4d3f-aa58-817943e60f32 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:21.674987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b8dc7-a491-4ed2-8d72-9bbbc552f396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:21.675704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8dc7-a491-4ed2-8d72-9bbbc552f396 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:21.675987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8dc7-a491-4ed2-8d72-9bbbc552f396 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:21.676263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8dc7-a491-4ed2-8d72-9bbbc552f396 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:21.686400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b8dc7-a491-4ed2-8d72-9bbbc552f396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-996b8dc7-a491-4ed2-8d72-9bbbc552f396 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:02:21.694542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:02:21.695666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:02:21.696593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 596/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:02:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:02:21.701703 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da30381-c99d-411d-bea7-721e1ea096cf None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:21.788337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:21.801272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da30381-c99d-411d-bea7-721e1ea096cf None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:21.834056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b9671-d27c-4322-8d81-77afe9469d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:21.834711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b9671-d27c-4322-8d81-77afe9469d25 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:21.834995 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b9671-d27c-4322-8d81-77afe9469d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:21.835269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b9671-d27c-4322-8d81-77afe9469d25 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:21.836011 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b9671-d27c-4322-8d81-77afe9469d25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:02:21.836317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b9671-d27c-4322-8d81-77afe9469d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:21.837717 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b9671-d27c-4322-8d81-77afe9469d25 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:21.845506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 600/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:02:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:02:21.851778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b8dc7-a491-4ed2-8d72-9bbbc552f396 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:21.950439 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b8dc7-a491-4ed2-8d72-9bbbc552f396 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:21.972746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:21.984707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c767b48-3296-41ea-9f27-548ec6f69baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:21.985558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767b48-3296-41ea-9f27-548ec6f69baf None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:21.985838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767b48-3296-41ea-9f27-548ec6f69baf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:21.986111 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767b48-3296-41ea-9f27-548ec6f69baf None admin] PATH_INFO: `/v3/users/b3536952e7ad4b33a8c1350ac371981e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:21.988365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c767b48-3296-41ea-9f27-548ec6f69baf None admin] RBAC: Authorizing `identity:get_user(user_id=b3536952e7ad4b33a8c1350ac371981e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:21.989832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c767b48-3296-41ea-9f27-548ec6f69baf None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:21.991435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 597/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jun 20 06:02:21 2022] GET /identity/v3/users/b3536952e7ad4b33a8c1350ac371981e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:21.997138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b9671-d27c-4322-8d81-77afe9469d25 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:22.094484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b9671-d27c-4322-8d81-77afe9469d25 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:22.126408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a66b2f-86a7-4699-b79c-ded03b2d09e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:22.127043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66b2f-86a7-4699-b79c-ded03b2d09e6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:22.127324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66b2f-86a7-4699-b79c-ded03b2d09e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:22.127599 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66b2f-86a7-4699-b79c-ded03b2d09e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:22.145694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:22.194768 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a66b2f-86a7-4699-b79c-ded03b2d09e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:22.196194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a66b2f-86a7-4699-b79c-ded03b2d09e6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:22.291786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 601/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:02:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:02:22.297468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c767b48-3296-41ea-9f27-548ec6f69baf None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:22.392848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c767b48-3296-41ea-9f27-548ec6f69baf None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:22.426396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83045f-c2da-430c-ba3b-560498baad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:22.427238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83045f-c2da-430c-ba3b-560498baad27 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:22.427518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83045f-c2da-430c-ba3b-560498baad27 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:22.427793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83045f-c2da-430c-ba3b-560498baad27 None admin] PATH_INFO: `/v3/projects/c321b6322e4f4e8fbc1a54f428b0025c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:22.428973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83045f-c2da-430c-ba3b-560498baad27 None admin] RBAC: Authorizing `identity:get_project(project_id=c321b6322e4f4e8fbc1a54f428b0025c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:22.430397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83045f-c2da-430c-ba3b-560498baad27 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:22.432061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 598/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jun 20 06:02:22 2022] GET /identity/v3/projects/c321b6322e4f4e8fbc1a54f428b0025c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:22.438014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a66b2f-86a7-4699-b79c-ded03b2d09e6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:22.485950 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:22.534935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a66b2f-86a7-4699-b79c-ded03b2d09e6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:22.568403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e5a11-8e2e-4380-983e-059123b55906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:22.569016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e5a11-8e2e-4380-983e-059123b55906 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:22.569301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e5a11-8e2e-4380-983e-059123b55906 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:22.569576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e5a11-8e2e-4380-983e-059123b55906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:22.570399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e5a11-8e2e-4380-983e-059123b55906 None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=c321b6322e4f4e8fbc1a54f428b0025c, user.id=b3536952e7ad4b33a8c1350ac371981e) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:02:22.570711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e5a11-8e2e-4380-983e-059123b55906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:22.572145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e5a11-8e2e-4380-983e-059123b55906 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:22.577837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 602/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:02:22 2022] GET /identity/v3/role_assignments?user.id=b3536952e7ad4b33a8c1350ac371981e&scope.project.id=c321b6322e4f4e8fbc1a54f428b0025c&role.id=efc16976111d431c9173186cbd0e6c24 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:02:32.422258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=71 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:32.575366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=43 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:18.477913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0870a-355d-418b-9752-046c41acda4a None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:18.478575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0870a-355d-418b-9752-046c41acda4a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:18.478575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0870a-355d-418b-9752-046c41acda4a None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:18.479856 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 599/1201] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:03:18.486252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5460be-7b62-48b9-a37d-ab0af15b5eb3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:18.487155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5460be-7b62-48b9-a37d-ab0af15b5eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:18.487155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5460be-7b62-48b9-a37d-ab0af15b5eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:18.507004 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bf5460be-7b62-48b9-a37d-ab0af15b5eb3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:18.508595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bf5460be-7b62-48b9-a37d-ab0af15b5eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:18.597847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 603/1202] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:03:18.626617 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0870a-355d-418b-9752-046c41acda4a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:18.755694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0870a-355d-418b-9752-046c41acda4a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:18.796008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714856-f9bd-4c35-a9d1-09285926ec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:18.796879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714856-f9bd-4c35-a9d1-09285926ec25 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:18.797198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714856-f9bd-4c35-a9d1-09285926ec25 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:18.797488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714856-f9bd-4c35-a9d1-09285926ec25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:18.810302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97714856-f9bd-4c35-a9d1-09285926ec25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:18.811867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97714856-f9bd-4c35-a9d1-09285926ec25 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-97714856-f9bd-4c35-a9d1-09285926ec25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:18.833891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:18.835179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:18.836204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:18.836204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:18.836204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:18.836204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:18.836204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 600/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:18.841841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5460be-7b62-48b9-a37d-ab0af15b5eb3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:18.988045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5460be-7b62-48b9-a37d-ab0af15b5eb3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:19.024894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:19.034809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac676311-02da-4d4e-ba5f-5b9b81846925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:19.035731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676311-02da-4d4e-ba5f-5b9b81846925 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:19.036301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676311-02da-4d4e-ba5f-5b9b81846925 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:19.037005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676311-02da-4d4e-ba5f-5b9b81846925 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:19.037907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac676311-02da-4d4e-ba5f-5b9b81846925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:19.038393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac676311-02da-4d4e-ba5f-5b9b81846925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:19.040132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac676311-02da-4d4e-ba5f-5b9b81846925 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:19.055093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 604/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:19.061722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714856-f9bd-4c35-a9d1-09285926ec25 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:19.148226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:19.221582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714856-f9bd-4c35-a9d1-09285926ec25 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:19.265295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ef78a-bd51-4115-a472-0ccb60d3f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:19.266018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ef78a-bd51-4115-a472-0ccb60d3f5cf None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:19.266307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ef78a-bd51-4115-a472-0ccb60d3f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:19.266587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ef78a-bd51-4115-a472-0ccb60d3f5cf None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:19.267310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ef78a-bd51-4115-a472-0ccb60d3f5cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:19.269471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ef78a-bd51-4115-a472-0ccb60d3f5cf None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:19.295651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 601/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jun 20 06:03:19 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:03:21.732733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0567a1-1ce9-45bc-9c20-f4f9821238f9 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:21.733290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0567a1-1ce9-45bc-9c20-f4f9821238f9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:21.733290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0567a1-1ce9-45bc-9c20-f4f9821238f9 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:21.738152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 605/1206] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:21.743845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9f896-f072-4ed0-b024-fcc02b8553d3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:21.744515 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9f896-f072-4ed0-b024-fcc02b8553d3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:21.744515 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9f896-f072-4ed0-b024-fcc02b8553d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:21.761863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-42b9f896-f072-4ed0-b024-fcc02b8553d3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:21.763147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-42b9f896-f072-4ed0-b024-fcc02b8553d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:21.841834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 602/1207] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:03:21.866360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0567a1-1ce9-45bc-9c20-f4f9821238f9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:21.982457 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0567a1-1ce9-45bc-9c20-f4f9821238f9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:22.024593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a700a4-38ef-4c9b-967d-e5140546b969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:22.025455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a700a4-38ef-4c9b-967d-e5140546b969 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:22.025743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a700a4-38ef-4c9b-967d-e5140546b969 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:22.026023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a700a4-38ef-4c9b-967d-e5140546b969 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:22.039241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a700a4-38ef-4c9b-967d-e5140546b969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-a4a700a4-38ef-4c9b-967d-e5140546b969 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:03:22.047268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:22.048563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:22.050149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 606/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:03:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:22.055025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9f896-f072-4ed0-b024-fcc02b8553d3 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:22.098493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:22.166400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9f896-f072-4ed0-b024-fcc02b8553d3 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:22.211320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2c677-f5b7-49c0-8992-8b04d6945335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:22.212049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2c677-f5b7-49c0-8992-8b04d6945335 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:22.212284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2c677-f5b7-49c0-8992-8b04d6945335 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:22.212584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2c677-f5b7-49c0-8992-8b04d6945335 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:22.213527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2c677-f5b7-49c0-8992-8b04d6945335 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:22.213935 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2c677-f5b7-49c0-8992-8b04d6945335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:22.215514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2c677-f5b7-49c0-8992-8b04d6945335 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:22.225301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 603/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:03:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:22.237295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a700a4-38ef-4c9b-967d-e5140546b969 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:22.295801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:22.349410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a700a4-38ef-4c9b-967d-e5140546b969 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:22.388706 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232dd38-4307-4906-bc76-9746c7910a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:22.389758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232dd38-4307-4906-bc76-9746c7910a15 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:22.389963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232dd38-4307-4906-bc76-9746c7910a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:22.390244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232dd38-4307-4906-bc76-9746c7910a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:22.401859 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232dd38-4307-4906-bc76-9746c7910a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:22.403455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232dd38-4307-4906-bc76-9746c7910a15 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-d232dd38-4307-4906-bc76-9746c7910a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:22.423135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:22.424765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:22.425942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:22.425942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:22.425942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:22.425942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:22.426249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 607/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:22.432134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2c677-f5b7-49c0-8992-8b04d6945335 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:22.546535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:22.550588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2c677-f5b7-49c0-8992-8b04d6945335 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:22.592577 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a944a3-c441-4ead-a27c-8e8bc80d196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:22.593473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a944a3-c441-4ead-a27c-8e8bc80d196a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:22.593836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a944a3-c441-4ead-a27c-8e8bc80d196a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:22.594305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a944a3-c441-4ead-a27c-8e8bc80d196a None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:22.595096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a944a3-c441-4ead-a27c-8e8bc80d196a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:22.595471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a944a3-c441-4ead-a27c-8e8bc80d196a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:22.598491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a944a3-c441-4ead-a27c-8e8bc80d196a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:22.613543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 604/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:03:22.619657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232dd38-4307-4906-bc76-9746c7910a15 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:22.732153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232dd38-4307-4906-bc76-9746c7910a15 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:22.734099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:22.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb451a-2f3a-41f7-b3d8-9d62b297c970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:22.772200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb451a-2f3a-41f7-b3d8-9d62b297c970 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:22.772490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb451a-2f3a-41f7-b3d8-9d62b297c970 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:22.772809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb451a-2f3a-41f7-b3d8-9d62b297c970 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:22.781434 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb451a-2f3a-41f7-b3d8-9d62b297c970 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:22.782911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb451a-2f3a-41f7-b3d8-9d62b297c970 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-0fdb451a-2f3a-41f7-b3d8-9d62b297c970 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:03:22.799644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:22.800830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:22.802053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:22.802053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:22.802053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:03:22.802053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:03:22.802053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:03:22.802053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:03:22.802053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:03:22.802053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:03:22.802053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:22.802053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:22.804094 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 608/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:22.810167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a944a3-c441-4ead-a27c-8e8bc80d196a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:22.939078 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a944a3-c441-4ead-a27c-8e8bc80d196a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:22.988376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8368b-427d-4f1b-8200-ac11cfaf78e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:22.989457 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8368b-427d-4f1b-8200-ac11cfaf78e5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:22.989945 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8368b-427d-4f1b-8200-ac11cfaf78e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:22.990639 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8368b-427d-4f1b-8200-ac11cfaf78e5 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:22.991744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8368b-427d-4f1b-8200-ac11cfaf78e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:22.992205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8368b-427d-4f1b-8200-ac11cfaf78e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:22.994179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8368b-427d-4f1b-8200-ac11cfaf78e5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:23.018571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 605/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jun 20 06:03:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:03:23.024701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb451a-2f3a-41f7-b3d8-9d62b297c970 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:23.159868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb451a-2f3a-41f7-b3d8-9d62b297c970 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:23.202426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbdac5-3347-4078-9516-5489b94987d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:23.204056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbdac5-3347-4078-9516-5489b94987d9 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:23.204056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbdac5-3347-4078-9516-5489b94987d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:23.204242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbdac5-3347-4078-9516-5489b94987d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:23.242475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:23.287303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbdac5-3347-4078-9516-5489b94987d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:23.288909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbdac5-3347-4078-9516-5489b94987d9 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:23.417904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 609/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:03:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 06:03:23.424731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8368b-427d-4f1b-8200-ac11cfaf78e5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:23.445249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:23.543832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8368b-427d-4f1b-8200-ac11cfaf78e5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:23.585196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae2d8a-0719-4f57-95d8-2da2b0193753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:23.586410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae2d8a-0719-4f57-95d8-2da2b0193753 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:23.586710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae2d8a-0719-4f57-95d8-2da2b0193753 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:23.587164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae2d8a-0719-4f57-95d8-2da2b0193753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:23.597822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae2d8a-0719-4f57-95d8-2da2b0193753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:23.599886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae2d8a-0719-4f57-95d8-2da2b0193753 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ccae2d8a-0719-4f57-95d8-2da2b0193753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:23.620278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:23.621510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:23.622692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:23.622692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:23.622692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:23.622692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:23.623830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 606/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:23.631475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbdac5-3347-4078-9516-5489b94987d9 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:23.707691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:23.757746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbdac5-3347-4078-9516-5489b94987d9 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:23.796368 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82009b7-af56-4740-912c-4016b3870a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:23.797107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82009b7-af56-4740-912c-4016b3870a2b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:23.797450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82009b7-af56-4740-912c-4016b3870a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:23.797741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82009b7-af56-4740-912c-4016b3870a2b None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:23.798610 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82009b7-af56-4740-912c-4016b3870a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:23.799005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82009b7-af56-4740-912c-4016b3870a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:23.800501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82009b7-af56-4740-912c-4016b3870a2b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:23.817873 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 610/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:23.819855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae2d8a-0719-4f57-95d8-2da2b0193753 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:23.901192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:23.937040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae2d8a-0719-4f57-95d8-2da2b0193753 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:23.979614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef434ad3-8997-421e-a7e5-1cb980535872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:23.980332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434ad3-8997-421e-a7e5-1cb980535872 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:23.980641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434ad3-8997-421e-a7e5-1cb980535872 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:23.980908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434ad3-8997-421e-a7e5-1cb980535872 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:23.989563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef434ad3-8997-421e-a7e5-1cb980535872 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:23.991044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef434ad3-8997-421e-a7e5-1cb980535872 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ef434ad3-8997-421e-a7e5-1cb980535872 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:03:24.007297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:24.008309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:24.014321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:03:24.014321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:03:24.014321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:03:24.014321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:03:24.014321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:03:24.014321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:03:24.014321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:24.014321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:24.014321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 607/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:24.014843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82009b7-af56-4740-912c-4016b3870a2b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:24.148813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82009b7-af56-4740-912c-4016b3870a2b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:24.176396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:24.189184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ee98f-f881-434a-abc7-77be5242af33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:24.189928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ee98f-f881-434a-abc7-77be5242af33 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:24.190378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ee98f-f881-434a-abc7-77be5242af33 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:24.190597 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ee98f-f881-434a-abc7-77be5242af33 None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:24.191558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ee98f-f881-434a-abc7-77be5242af33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:24.191890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ee98f-f881-434a-abc7-77be5242af33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:24.193348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ee98f-f881-434a-abc7-77be5242af33 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:24.211412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 611/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:24.212903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef434ad3-8997-421e-a7e5-1cb980535872 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:24.331181 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef434ad3-8997-421e-a7e5-1cb980535872 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:24.363926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:24.370212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc429908-4d4f-4b4c-ba7e-5aa874641d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:24.370990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc429908-4d4f-4b4c-ba7e-5aa874641d1e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:24.371424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc429908-4d4f-4b4c-ba7e-5aa874641d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:24.371800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc429908-4d4f-4b4c-ba7e-5aa874641d1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:24.372854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc429908-4d4f-4b4c-ba7e-5aa874641d1e None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=577f89ef22954926bdf02a15484f8f17) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:24.373208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc429908-4d4f-4b4c-ba7e-5aa874641d1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:24.374766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc429908-4d4f-4b4c-ba7e-5aa874641d1e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:24.393140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 608/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:03:24 2022] GET /identity/v3/role_assignments?user.id=577f89ef22954926bdf02a15484f8f17&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:03:26.480367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59606d-efad-4f0a-b0b4-3f7812c73f02 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.480975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59606d-efad-4f0a-b0b4-3f7812c73f02 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.480975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59606d-efad-4f0a-b0b4-3f7812c73f02 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.482337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 612/1220] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:26.488017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d11865-771f-40b5-afc4-bf6c285c2d2b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.488447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d11865-771f-40b5-afc4-bf6c285c2d2b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.488574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d11865-771f-40b5-afc4-bf6c285c2d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.507990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-20d11865-771f-40b5-afc4-bf6c285c2d2b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:26.509651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-20d11865-771f-40b5-afc4-bf6c285c2d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:26.582772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 609/1221] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:03:26.607104 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59606d-efad-4f0a-b0b4-3f7812c73f02 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:26.725015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59606d-efad-4f0a-b0b4-3f7812c73f02 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:26.762434 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7103a8-68d2-49b3-870e-672b9520cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:26.763163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7103a8-68d2-49b3-870e-672b9520cc37 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.763445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7103a8-68d2-49b3-870e-672b9520cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.763720 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7103a8-68d2-49b3-870e-672b9520cc37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.774064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7103a8-68d2-49b3-870e-672b9520cc37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-6a7103a8-68d2-49b3-870e-672b9520cc37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:03:26.781840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:26.783025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:26.790020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 613/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:03:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:26.790746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d11865-771f-40b5-afc4-bf6c285c2d2b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:26.901170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d11865-771f-40b5-afc4-bf6c285c2d2b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:26.928920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:26.941720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4d798-bae8-4d69-86ae-25d11aaa4546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:26.942715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d798-bae8-4d69-86ae-25d11aaa4546 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.943003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d798-bae8-4d69-86ae-25d11aaa4546 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.943318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d798-bae8-4d69-86ae-25d11aaa4546 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.944138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4d798-bae8-4d69-86ae-25d11aaa4546 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:26.944668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4d798-bae8-4d69-86ae-25d11aaa4546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:26.946495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4d798-bae8-4d69-86ae-25d11aaa4546 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:26.958338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 610/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:03:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:26.964537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7103a8-68d2-49b3-870e-672b9520cc37 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:27.015770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:27.077742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7103a8-68d2-49b3-870e-672b9520cc37 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:27.118564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1a4ae-84dd-4880-93e9-9a9e508706ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:27.119368 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a4ae-84dd-4880-93e9-9a9e508706ee None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:27.119639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a4ae-84dd-4880-93e9-9a9e508706ee None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:27.119908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a4ae-84dd-4880-93e9-9a9e508706ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:27.132148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1a4ae-84dd-4880-93e9-9a9e508706ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:27.134350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1a4ae-84dd-4880-93e9-9a9e508706ee None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-21a1a4ae-84dd-4880-93e9-9a9e508706ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:27.155456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:27.156409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:27.157931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:27.157931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:27.157931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:27.157931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:27.157931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 614/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:27.163334 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4d798-bae8-4d69-86ae-25d11aaa4546 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:27.276001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4d798-bae8-4d69-86ae-25d11aaa4546 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:27.316776 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a13d9d-c712-4b1b-a6e2-4bee515c436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:27.317577 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13d9d-c712-4b1b-a6e2-4bee515c436f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:27.317949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13d9d-c712-4b1b-a6e2-4bee515c436f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:27.318228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13d9d-c712-4b1b-a6e2-4bee515c436f None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:27.318950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a13d9d-c712-4b1b-a6e2-4bee515c436f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:27.319255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a13d9d-c712-4b1b-a6e2-4bee515c436f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:27.320907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a13d9d-c712-4b1b-a6e2-4bee515c436f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:27.337403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 611/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:27.344420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1a4ae-84dd-4880-93e9-9a9e508706ee None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:27.475314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:27.482777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1a4ae-84dd-4880-93e9-9a9e508706ee None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:27.521351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b45fb4-db2a-4381-a811-01240a747335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:27.522157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b45fb4-db2a-4381-a811-01240a747335 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:27.522439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b45fb4-db2a-4381-a811-01240a747335 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:27.522709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b45fb4-db2a-4381-a811-01240a747335 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:27.531027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b45fb4-db2a-4381-a811-01240a747335 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:27.532462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b45fb4-db2a-4381-a811-01240a747335 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-46b45fb4-db2a-4381-a811-01240a747335 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:03:27.547461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:27.548774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:27.549786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:27.549786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:27.549786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:03:27.549786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:03:27.549786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:03:27.549786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:03:27.549786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:03:27.549786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:03:27.549786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:27.549786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:27.549786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 615/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:27.555695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a13d9d-c712-4b1b-a6e2-4bee515c436f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:27.617433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:27.690040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a13d9d-c712-4b1b-a6e2-4bee515c436f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:27.727961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1a089-0712-45b6-adee-775c58de79d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:27.728658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1a089-0712-45b6-adee-775c58de79d8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:27.728951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1a089-0712-45b6-adee-775c58de79d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:27.729233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1a089-0712-45b6-adee-775c58de79d8 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:27.730218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1a089-0712-45b6-adee-775c58de79d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:27.730529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1a089-0712-45b6-adee-775c58de79d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:27.731966 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1a089-0712-45b6-adee-775c58de79d8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:27.750922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 612/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jun 20 06:03:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:27.757020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b45fb4-db2a-4381-a811-01240a747335 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:27.874399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b45fb4-db2a-4381-a811-01240a747335 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:27.916756 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368640d-10c7-40b8-b3b5-288707441884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:27.917664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368640d-10c7-40b8-b3b5-288707441884 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:27.917988 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368640d-10c7-40b8-b3b5-288707441884 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:27.918305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368640d-10c7-40b8-b3b5-288707441884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:27.933102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368640d-10c7-40b8-b3b5-288707441884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:27.934580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368640d-10c7-40b8-b3b5-288707441884 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-0368640d-10c7-40b8-b3b5-288707441884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:27.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:27.953856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:27.954915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:27.954915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:27.954915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:27.954915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:27.954915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 616/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:03:27.960175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1a089-0712-45b6-adee-775c58de79d8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:28.077703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1a089-0712-45b6-adee-775c58de79d8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:28.081680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:28.119140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08342e4a-fb5d-4640-aa9b-fe304fc7385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:28.119964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08342e4a-fb5d-4640-aa9b-fe304fc7385f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:28.120294 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08342e4a-fb5d-4640-aa9b-fe304fc7385f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:28.120646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08342e4a-fb5d-4640-aa9b-fe304fc7385f None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:28.121372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08342e4a-fb5d-4640-aa9b-fe304fc7385f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:28.121834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08342e4a-fb5d-4640-aa9b-fe304fc7385f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:28.123596 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08342e4a-fb5d-4640-aa9b-fe304fc7385f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:28.142175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 613/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:28.144910 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368640d-10c7-40b8-b3b5-288707441884 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:28.154926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:28.269849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368640d-10c7-40b8-b3b5-288707441884 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:28.309088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89764d6-9c81-4761-81be-813ef69f3016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:28.309926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89764d6-9c81-4761-81be-813ef69f3016 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:28.310207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89764d6-9c81-4761-81be-813ef69f3016 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:28.310484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89764d6-9c81-4761-81be-813ef69f3016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:28.318405 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89764d6-9c81-4761-81be-813ef69f3016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:28.319865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89764d6-9c81-4761-81be-813ef69f3016 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-a89764d6-9c81-4761-81be-813ef69f3016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:03:28.335397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:28.336543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:28.337546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:03:28.337546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:03:28.337546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:03:28.337546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:03:28.337546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:03:28.337546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:03:28.337546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:28.337546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:28.337546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 617/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:03:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:28.342704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08342e4a-fb5d-4640-aa9b-fe304fc7385f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:28.470156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08342e4a-fb5d-4640-aa9b-fe304fc7385f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:28.508807 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a0c31-a65b-47bf-b359-5a240d0d2370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:28.509564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a0c31-a65b-47bf-b359-5a240d0d2370 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:28.509924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a0c31-a65b-47bf-b359-5a240d0d2370 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:28.510275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a0c31-a65b-47bf-b359-5a240d0d2370 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:28.511171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a0c31-a65b-47bf-b359-5a240d0d2370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:28.511521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a0c31-a65b-47bf-b359-5a240d0d2370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:28.513071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a0c31-a65b-47bf-b359-5a240d0d2370 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:28.528169 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 614/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:03:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:03:28.535639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89764d6-9c81-4761-81be-813ef69f3016 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:28.622239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:28.666850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89764d6-9c81-4761-81be-813ef69f3016 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:28.706984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc6675-2def-4195-85af-e4ca4bedc49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:28.708484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc6675-2def-4195-85af-e4ca4bedc49e None admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:28.708853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc6675-2def-4195-85af-e4ca4bedc49e None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:28.709260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc6675-2def-4195-85af-e4ca4bedc49e None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/577f89ef22954926bdf02a15484f8f17/roles/acb584c0cfb34695a7cd4ba39aabb279` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:28.725895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc6675-2def-4195-85af-e4ca4bedc49e None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=577f89ef22954926bdf02a15484f8f17, role_id=acb584c0cfb34695a7cd4ba39aabb279)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:28.727284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc6675-2def-4195-85af-e4ca4bedc49e None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:28.741130 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 618/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:03:28 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/577f89ef22954926bdf02a15484f8f17/roles/acb584c0cfb34695a7cd4ba39aabb279 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:03:30.907769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbb671-96db-4c75-80f4-edb77aef72f4 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:30.908416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbb671-96db-4c75-80f4-edb77aef72f4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:30.908416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbb671-96db-4c75-80f4-edb77aef72f4 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:30.910165 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 615/1233] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:30.916138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b45b0-40b0-4b51-b39b-15cf6bac2201 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:30.916568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b45b0-40b0-4b51-b39b-15cf6bac2201 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:30.916731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b45b0-40b0-4b51-b39b-15cf6bac2201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:30.935910 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-196b45b0-40b0-4b51-b39b-15cf6bac2201 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:30.937165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-196b45b0-40b0-4b51-b39b-15cf6bac2201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:31.019309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 619/1234] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:03:31.048402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbb671-96db-4c75-80f4-edb77aef72f4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:31.074552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:31.165744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbb671-96db-4c75-80f4-edb77aef72f4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:31.212004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4ff8c-9cb8-4801-b620-fae55ca8926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:31.212877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4ff8c-9cb8-4801-b620-fae55ca8926b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:31.213173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4ff8c-9cb8-4801-b620-fae55ca8926b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:31.213488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4ff8c-9cb8-4801-b620-fae55ca8926b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:31.226062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4ff8c-9cb8-4801-b620-fae55ca8926b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-5ad4ff8c-9cb8-4801-b620-fae55ca8926b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:03:31.233896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:31.235095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 06:03:31.236186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:31.240528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 616/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jun 20 06:03:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:03:31.241437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b45b0-40b0-4b51-b39b-15cf6bac2201 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:31.295697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:31.364107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b45b0-40b0-4b51-b39b-15cf6bac2201 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:31.408522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0227781-ace6-48a4-bb3c-5aa88eb3dfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:31.409361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0227781-ace6-48a4-bb3c-5aa88eb3dfec None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:31.409767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0227781-ace6-48a4-bb3c-5aa88eb3dfec None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:31.410091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0227781-ace6-48a4-bb3c-5aa88eb3dfec None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:31.411031 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0227781-ace6-48a4-bb3c-5aa88eb3dfec None admin] RBAC: Adding query filter params (name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:31.411417 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0227781-ace6-48a4-bb3c-5aa88eb3dfec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:31.413452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0227781-ace6-48a4-bb3c-5aa88eb3dfec None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:31.424964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 620/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jun 20 06:03:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:31.430987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4ff8c-9cb8-4801-b620-fae55ca8926b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:31.529408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:31.549658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4ff8c-9cb8-4801-b620-fae55ca8926b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:31.587939 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87163c-3bf6-4484-a370-b6e7d41b76a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:31.589184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87163c-3bf6-4484-a370-b6e7d41b76a7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:31.589571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87163c-3bf6-4484-a370-b6e7d41b76a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:31.589848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87163c-3bf6-4484-a370-b6e7d41b76a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:31.602580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87163c-3bf6-4484-a370-b6e7d41b76a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:31.604168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87163c-3bf6-4484-a370-b6e7d41b76a7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-bd87163c-3bf6-4484-a370-b6e7d41b76a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:31.625647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:31.626619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:31.629272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:31.629272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:31.629272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:31.629272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:31.629272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 617/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:31.633019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0227781-ace6-48a4-bb3c-5aa88eb3dfec None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:31.753964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0227781-ace6-48a4-bb3c-5aa88eb3dfec None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:31.763527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:31.793877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1936795-9e01-4a36-af0e-5c45b786531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:31.794754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1936795-9e01-4a36-af0e-5c45b786531c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:31.795189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1936795-9e01-4a36-af0e-5c45b786531c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:31.795579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1936795-9e01-4a36-af0e-5c45b786531c None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:31.796403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1936795-9e01-4a36-af0e-5c45b786531c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:31.796788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1936795-9e01-4a36-af0e-5c45b786531c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:31.798462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1936795-9e01-4a36-af0e-5c45b786531c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:31.818049 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 621/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:31.824184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87163c-3bf6-4484-a370-b6e7d41b76a7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:31.955189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87163c-3bf6-4484-a370-b6e7d41b76a7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:31.994846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158008d-07df-4cbd-a57a-b3867ae22ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:31.995784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158008d-07df-4cbd-a57a-b3867ae22ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:31.996102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158008d-07df-4cbd-a57a-b3867ae22ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:31.996407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158008d-07df-4cbd-a57a-b3867ae22ff3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:31.999219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:32.005068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158008d-07df-4cbd-a57a-b3867ae22ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:32.007151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158008d-07df-4cbd-a57a-b3867ae22ff3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b158008d-07df-4cbd-a57a-b3867ae22ff3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:03:32.022636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:32.024177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:32.026114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:32.026114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:32.026114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:03:32.026114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:03:32.026114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:03:32.026114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:03:32.026114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:03:32.026114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:03:32.026114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:32.026114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:32.026114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 618/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:03:32.029867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1936795-9e01-4a36-af0e-5c45b786531c None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:32.136377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1936795-9e01-4a36-af0e-5c45b786531c None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:32.173074 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf035b5-581a-41f7-a773-a3cb0bd8cd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:32.174372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf035b5-581a-41f7-a773-a3cb0bd8cd91 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:32.174666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf035b5-581a-41f7-a773-a3cb0bd8cd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:32.174947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf035b5-581a-41f7-a773-a3cb0bd8cd91 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:32.175796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf035b5-581a-41f7-a773-a3cb0bd8cd91 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:32.176100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf035b5-581a-41f7-a773-a3cb0bd8cd91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:32.177607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf035b5-581a-41f7-a773-a3cb0bd8cd91 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:32.195901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 622/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jun 20 06:03:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:32.202574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158008d-07df-4cbd-a57a-b3867ae22ff3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:32.335798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158008d-07df-4cbd-a57a-b3867ae22ff3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:32.373523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a7af2-2579-438d-8adf-15d42cc99d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:32.374228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7af2-2579-438d-8adf-15d42cc99d15 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:32.374523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7af2-2579-438d-8adf-15d42cc99d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:32.374799 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7af2-2579-438d-8adf-15d42cc99d15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:32.445724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:32.453155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a7af2-2579-438d-8adf-15d42cc99d15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:32.454619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a7af2-2579-438d-8adf-15d42cc99d15 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:32.578310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 619/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:03:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:03:32.584320 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf035b5-581a-41f7-a773-a3cb0bd8cd91 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:32.616338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:32.698585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf035b5-581a-41f7-a773-a3cb0bd8cd91 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:32.737236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370693e-f126-44d0-8c52-f9c95f5ed062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:32.738068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370693e-f126-44d0-8c52-f9c95f5ed062 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:32.738390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370693e-f126-44d0-8c52-f9c95f5ed062 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:32.738658 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370693e-f126-44d0-8c52-f9c95f5ed062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:32.749763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370693e-f126-44d0-8c52-f9c95f5ed062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:32.751381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370693e-f126-44d0-8c52-f9c95f5ed062 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3370693e-f126-44d0-8c52-f9c95f5ed062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:32.770085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:32.771383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:32.777070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:32.777070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:32.777070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:32.777070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:32.777070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 623/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:32.777427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a7af2-2579-438d-8adf-15d42cc99d15 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:32.876575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:32.883145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a7af2-2579-438d-8adf-15d42cc99d15 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:32.924713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31546e-9bdb-4b83-a6e8-6ef7485dc4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:32.925396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31546e-9bdb-4b83-a6e8-6ef7485dc4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:32.925683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31546e-9bdb-4b83-a6e8-6ef7485dc4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:32.927233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31546e-9bdb-4b83-a6e8-6ef7485dc4c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:32.928013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31546e-9bdb-4b83-a6e8-6ef7485dc4c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:32.928305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31546e-9bdb-4b83-a6e8-6ef7485dc4c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:32.929722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31546e-9bdb-4b83-a6e8-6ef7485dc4c8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:32.945191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 620/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:03:32.950980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370693e-f126-44d0-8c52-f9c95f5ed062 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:33.032945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:33.058590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370693e-f126-44d0-8c52-f9c95f5ed062 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:33.097922 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db07c2c-157e-4670-8f2d-34356e8083a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:33.098719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db07c2c-157e-4670-8f2d-34356e8083a6 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:33.099003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db07c2c-157e-4670-8f2d-34356e8083a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:33.099278 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db07c2c-157e-4670-8f2d-34356e8083a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:33.106244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db07c2c-157e-4670-8f2d-34356e8083a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:33.107738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db07c2c-157e-4670-8f2d-34356e8083a6 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-3db07c2c-157e-4670-8f2d-34356e8083a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:03:33.123444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:33.124727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:33.125749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:03:33.125749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:03:33.125749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:03:33.125749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:03:33.125749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:03:33.125749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:03:33.125749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:33.125749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:33.125749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 624/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:33.131193 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31546e-9bdb-4b83-a6e8-6ef7485dc4c8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:33.243218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31546e-9bdb-4b83-a6e8-6ef7485dc4c8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:33.283165 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128f780-0991-4e64-afff-e99a989602c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:33.284193 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128f780-0991-4e64-afff-e99a989602c2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:33.284671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128f780-0991-4e64-afff-e99a989602c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:33.284960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128f780-0991-4e64-afff-e99a989602c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:33.285753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128f780-0991-4e64-afff-e99a989602c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:33.286067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128f780-0991-4e64-afff-e99a989602c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:33.287752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128f780-0991-4e64-afff-e99a989602c2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:33.301453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 621/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:03:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:33.307554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db07c2c-157e-4670-8f2d-34356e8083a6 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:33.425742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db07c2c-157e-4670-8f2d-34356e8083a6 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:33.463066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3242d5e-c1a5-4d9f-95cf-ebb11b2ef305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:33.463722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242d5e-c1a5-4d9f-95cf-ebb11b2ef305 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:33.464064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242d5e-c1a5-4d9f-95cf-ebb11b2ef305 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:33.464290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242d5e-c1a5-4d9f-95cf-ebb11b2ef305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:33.465157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3242d5e-c1a5-4d9f-95cf-ebb11b2ef305 None admin] RBAC: Adding query filter params (role.id=acb584c0cfb34695a7cd4ba39aabb279, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=577f89ef22954926bdf02a15484f8f17) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:33.465466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3242d5e-c1a5-4d9f-95cf-ebb11b2ef305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:33.466908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3242d5e-c1a5-4d9f-95cf-ebb11b2ef305 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:33.484640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 625/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:03:33 2022] GET /identity/v3/role_assignments?user.id=577f89ef22954926bdf02a15484f8f17&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=acb584c0cfb34695a7cd4ba39aabb279 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:35.714026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4926-b525-4dc0-b670-a423c0026c91 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:35.714582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4926-b525-4dc0-b670-a423c0026c91 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:35.714582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4926-b525-4dc0-b670-a423c0026c91 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:35.716109 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 622/1247] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:35.722210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0783cbf-4185-4f4c-94ec-52fe2f8ae101 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:35.722915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0783cbf-4185-4f4c-94ec-52fe2f8ae101 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:35.722915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0783cbf-4185-4f4c-94ec-52fe2f8ae101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:35.728642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:35.742048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b0783cbf-4185-4f4c-94ec-52fe2f8ae101 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:35.743379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b0783cbf-4185-4f4c-94ec-52fe2f8ae101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:35.823366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 626/1248] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:03:35.848150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d4926-b525-4dc0-b670-a423c0026c91 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:35.868325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:35.958500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d4926-b525-4dc0-b670-a423c0026c91 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:35.997362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda1365-6f55-4663-a1a0-30bbeb1fb786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:35.998171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda1365-6f55-4663-a1a0-30bbeb1fb786 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:35.998460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda1365-6f55-4663-a1a0-30bbeb1fb786 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:35.998737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda1365-6f55-4663-a1a0-30bbeb1fb786 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:36.010924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda1365-6f55-4663-a1a0-30bbeb1fb786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ccda1365-6f55-4663-a1a0-30bbeb1fb786 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:03:36.019851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:36.021051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:36.022104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 623/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:36.027909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0783cbf-4185-4f4c-94ec-52fe2f8ae101 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:36.135691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0783cbf-4185-4f4c-94ec-52fe2f8ae101 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:36.168820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:36.175356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440758e-d5a1-4006-9082-17ba8c870c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:36.176049 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440758e-d5a1-4006-9082-17ba8c870c85 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:36.176334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440758e-d5a1-4006-9082-17ba8c870c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:36.176678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440758e-d5a1-4006-9082-17ba8c870c85 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:36.177448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440758e-d5a1-4006-9082-17ba8c870c85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:36.177765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440758e-d5a1-4006-9082-17ba8c870c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:36.179331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440758e-d5a1-4006-9082-17ba8c870c85 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:36.187907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 627/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:03:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:36.194143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda1365-6f55-4663-a1a0-30bbeb1fb786 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:36.286428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:36.314493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda1365-6f55-4663-a1a0-30bbeb1fb786 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:36.359488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae6b80-6b29-4261-ac9e-256b825eb615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:36.360322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae6b80-6b29-4261-ac9e-256b825eb615 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:36.360637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae6b80-6b29-4261-ac9e-256b825eb615 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:36.360958 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae6b80-6b29-4261-ac9e-256b825eb615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:36.374118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae6b80-6b29-4261-ac9e-256b825eb615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:36.375756 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae6b80-6b29-4261-ac9e-256b825eb615 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-57ae6b80-6b29-4261-ac9e-256b825eb615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:36.398716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:36.400268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:36.401625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:36.401625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:36.401625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:36.401625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:36.401625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 624/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:36.406361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440758e-d5a1-4006-9082-17ba8c870c85 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:36.528225 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440758e-d5a1-4006-9082-17ba8c870c85 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:36.566706 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5180b-6684-4625-97c6-96be277b406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:36.567298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5180b-6684-4625-97c6-96be277b406d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:36.567600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5180b-6684-4625-97c6-96be277b406d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:36.567947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5180b-6684-4625-97c6-96be277b406d None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:36.568644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5180b-6684-4625-97c6-96be277b406d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:36.568960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5180b-6684-4625-97c6-96be277b406d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:36.570343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5180b-6684-4625-97c6-96be277b406d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:36.582456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 628/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:36.588801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae6b80-6b29-4261-ac9e-256b825eb615 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:36.712268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae6b80-6b29-4261-ac9e-256b825eb615 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:36.741783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:36.753801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b796c-ad2b-4f5d-9554-fb439502d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:36.754969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b796c-ad2b-4f5d-9554-fb439502d8ce None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:36.755240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b796c-ad2b-4f5d-9554-fb439502d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:36.755519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b796c-ad2b-4f5d-9554-fb439502d8ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:36.765372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b796c-ad2b-4f5d-9554-fb439502d8ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:36.767284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b796c-ad2b-4f5d-9554-fb439502d8ce None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-926b796c-ad2b-4f5d-9554-fb439502d8ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:03:36.786446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:36.787874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:36.789052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:36.789052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:36.789052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:03:36.789052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:03:36.789052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:03:36.789052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:03:36.789052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:03:36.789052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:03:36.789052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:36.789052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:36.789052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 625/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:03:36.794505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5180b-6684-4625-97c6-96be277b406d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:36.856891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:36.903076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5180b-6684-4625-97c6-96be277b406d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:36.939638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933d16b-3ba0-411d-a69c-f0d964713523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:36.940308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933d16b-3ba0-411d-a69c-f0d964713523 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:36.940585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933d16b-3ba0-411d-a69c-f0d964713523 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:36.940881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933d16b-3ba0-411d-a69c-f0d964713523 None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:36.941718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933d16b-3ba0-411d-a69c-f0d964713523 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:36.942028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933d16b-3ba0-411d-a69c-f0d964713523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:36.943486 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933d16b-3ba0-411d-a69c-f0d964713523 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:36.961436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 629/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jun 20 06:03:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:03:36.967314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b796c-ad2b-4f5d-9554-fb439502d8ce None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:37.076016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b796c-ad2b-4f5d-9554-fb439502d8ce None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:37.111512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1a777-2a09-484f-9354-1e92ef519673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:37.112110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1a777-2a09-484f-9354-1e92ef519673 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:37.112446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1a777-2a09-484f-9354-1e92ef519673 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:37.112758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1a777-2a09-484f-9354-1e92ef519673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:37.171061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.184868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1a777-2a09-484f-9354-1e92ef519673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:37.186405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1a777-2a09-484f-9354-1e92ef519673 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:37.298063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 626/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:03:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 06:03:37.299905 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933d16b-3ba0-411d-a69c-f0d964713523 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:37.416099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933d16b-3ba0-411d-a69c-f0d964713523 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:37.431368 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.455058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3829af-0ec4-46ec-bc5a-d1368a2ff576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:37.456001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3829af-0ec4-46ec-bc5a-d1368a2ff576 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:37.456267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3829af-0ec4-46ec-bc5a-d1368a2ff576 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:37.456542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3829af-0ec4-46ec-bc5a-d1368a2ff576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:37.467761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3829af-0ec4-46ec-bc5a-d1368a2ff576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:37.469331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3829af-0ec4-46ec-bc5a-d1368a2ff576 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ef3829af-0ec4-46ec-bc5a-d1368a2ff576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:37.487822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:37.489018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:37.489946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:37.489946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:37.489946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:37.489946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:37.489946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 630/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:37.495267 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1a777-2a09-484f-9354-1e92ef519673 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:37.595247 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.613321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1a777-2a09-484f-9354-1e92ef519673 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:37.651224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f572c3-5164-4cb1-8d40-82dd9b26d43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:37.651919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f572c3-5164-4cb1-8d40-82dd9b26d43f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:37.652200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f572c3-5164-4cb1-8d40-82dd9b26d43f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:37.652481 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f572c3-5164-4cb1-8d40-82dd9b26d43f None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:37.653239 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f572c3-5164-4cb1-8d40-82dd9b26d43f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:37.653552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f572c3-5164-4cb1-8d40-82dd9b26d43f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:37.654928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f572c3-5164-4cb1-8d40-82dd9b26d43f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:37.672053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 627/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:37.673141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3829af-0ec4-46ec-bc5a-d1368a2ff576 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:37.787958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3829af-0ec4-46ec-bc5a-d1368a2ff576 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:37.826230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe89ba7-b879-4cec-ab84-8d694f957497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:37.827044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe89ba7-b879-4cec-ab84-8d694f957497 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:37.827327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe89ba7-b879-4cec-ab84-8d694f957497 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:37.827604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe89ba7-b879-4cec-ab84-8d694f957497 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:37.835543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe89ba7-b879-4cec-ab84-8d694f957497 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:37.837072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe89ba7-b879-4cec-ab84-8d694f957497 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-bbe89ba7-b879-4cec-ab84-8d694f957497 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:03:37.851972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:37.853041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:37.854161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:03:37.854161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:03:37.854161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:03:37.854161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:03:37.854161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:03:37.854161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:03:37.854161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:37.854161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:37.854161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 631/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:03:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:03:37.859278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f572c3-5164-4cb1-8d40-82dd9b26d43f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:37.966526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f572c3-5164-4cb1-8d40-82dd9b26d43f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:38.003590 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca06a72-3e83-4d4f-8764-f0c8447e3a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:38.004255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca06a72-3e83-4d4f-8764-f0c8447e3a70 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:38.004543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca06a72-3e83-4d4f-8764-f0c8447e3a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:38.004851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca06a72-3e83-4d4f-8764-f0c8447e3a70 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:38.005644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca06a72-3e83-4d4f-8764-f0c8447e3a70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:38.005956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca06a72-3e83-4d4f-8764-f0c8447e3a70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:38.007389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca06a72-3e83-4d4f-8764-f0c8447e3a70 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:38.019967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 628/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:03:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:38.026456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe89ba7-b879-4cec-ab84-8d694f957497 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:38.055628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:38.133411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe89ba7-b879-4cec-ab84-8d694f957497 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:38.169030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16532af-1370-4337-9b6d-81a4c4808f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:38.169700 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16532af-1370-4337-9b6d-81a4c4808f1d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:38.169984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16532af-1370-4337-9b6d-81a4c4808f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:38.170260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16532af-1370-4337-9b6d-81a4c4808f1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:38.171103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16532af-1370-4337-9b6d-81a4c4808f1d None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=577f89ef22954926bdf02a15484f8f17) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:38.171417 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16532af-1370-4337-9b6d-81a4c4808f1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:38.172896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16532af-1370-4337-9b6d-81a4c4808f1d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:38.183233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 632/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:03:38 2022] GET /identity/v3/role_assignments?user.id=577f89ef22954926bdf02a15484f8f17&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=efc16976111d431c9173186cbd0e6c24 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:40.180384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d199-5ba8-4729-85a2-641b41a9f034 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:40.180942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d199-5ba8-4729-85a2-641b41a9f034 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:40.181053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0d199-5ba8-4729-85a2-641b41a9f034 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:40.182355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 629/1261] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:40.187559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5296c-7916-4024-81df-63db1fa1d81f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:40.187999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5296c-7916-4024-81df-63db1fa1d81f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:40.188102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5296c-7916-4024-81df-63db1fa1d81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:40.204557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b0e5296c-7916-4024-81df-63db1fa1d81f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:40.205765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b0e5296c-7916-4024-81df-63db1fa1d81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:40.270452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 633/1262] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:03:40.293678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0d199-5ba8-4729-85a2-641b41a9f034 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:40.305096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:40.400464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0d199-5ba8-4729-85a2-641b41a9f034 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:40.439773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b7f95-a12b-4888-8976-32bd551f330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:40.441006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b7f95-a12b-4888-8976-32bd551f330d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:40.441482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b7f95-a12b-4888-8976-32bd551f330d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:40.441980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b7f95-a12b-4888-8976-32bd551f330d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:40.452524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b7f95-a12b-4888-8976-32bd551f330d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-a98b7f95-a12b-4888-8976-32bd551f330d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:03:40.460330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:40.461491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:40.462539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 630/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:03:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:40.467586 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5296c-7916-4024-81df-63db1fa1d81f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:40.486812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:40.566959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5296c-7916-4024-81df-63db1fa1d81f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:40.601735 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36b5cc-c73e-4f42-9cf5-23d50f9fcab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:40.602392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b5cc-c73e-4f42-9cf5-23d50f9fcab7 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:40.602678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b5cc-c73e-4f42-9cf5-23d50f9fcab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:40.602956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36b5cc-c73e-4f42-9cf5-23d50f9fcab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:40.603704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36b5cc-c73e-4f42-9cf5-23d50f9fcab7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:40.604012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36b5cc-c73e-4f42-9cf5-23d50f9fcab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:40.605415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36b5cc-c73e-4f42-9cf5-23d50f9fcab7 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:40.614150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 634/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:03:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:40.619769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b7f95-a12b-4888-8976-32bd551f330d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:40.686821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:40.720313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b7f95-a12b-4888-8976-32bd551f330d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:40.753896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb6217-93a4-4de1-aaa7-340ae6cb83b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:40.754669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb6217-93a4-4de1-aaa7-340ae6cb83b8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:40.754951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb6217-93a4-4de1-aaa7-340ae6cb83b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:40.755225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb6217-93a4-4de1-aaa7-340ae6cb83b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:40.765275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb6217-93a4-4de1-aaa7-340ae6cb83b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:40.766709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb6217-93a4-4de1-aaa7-340ae6cb83b8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-82fb6217-93a4-4de1-aaa7-340ae6cb83b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:40.785093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:40.786105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:40.792117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:40.792117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:40.792117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:40.792117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:40.792117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 631/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 06:03:40.792486 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36b5cc-c73e-4f42-9cf5-23d50f9fcab7 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:40.870975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:40.889150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36b5cc-c73e-4f42-9cf5-23d50f9fcab7 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:40.922303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd656-c6c2-42ac-906e-ee614809c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:40.922951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd656-c6c2-42ac-906e-ee614809c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:40.923236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd656-c6c2-42ac-906e-ee614809c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:40.923512 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd656-c6c2-42ac-906e-ee614809c6d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:40.924346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecd656-c6c2-42ac-906e-ee614809c6d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:40.924589 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecd656-c6c2-42ac-906e-ee614809c6d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:40.925989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecd656-c6c2-42ac-906e-ee614809c6d1 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:40.937372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 635/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:40.943475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb6217-93a4-4de1-aaa7-340ae6cb83b8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:41.040740 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb6217-93a4-4de1-aaa7-340ae6cb83b8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:41.059438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:41.074499 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97088012-a684-4672-a557-23ed96f7abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:41.075280 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088012-a684-4672-a557-23ed96f7abbe None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:41.075561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088012-a684-4672-a557-23ed96f7abbe None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:41.075834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088012-a684-4672-a557-23ed96f7abbe None admin] PATH_INFO: `/v3/users/placement` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:41.084158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97088012-a684-4672-a557-23ed96f7abbe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:41.085670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97088012-a684-4672-a557-23ed96f7abbe None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-97088012-a684-4672-a557-23ed96f7abbe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:03:41.099944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:41.101099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:41.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:41.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:41.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:03:41.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:03:41.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:03:41.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:03:41.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:03:41.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:03:41.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:41.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:41.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 632/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:41.106805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd656-c6c2-42ac-906e-ee614809c6d1 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:41.206752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd656-c6c2-42ac-906e-ee614809c6d1 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:41.239890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021005fa-bfaa-427d-8fa8-a52876bda60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:41.240545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021005fa-bfaa-427d-8fa8-a52876bda60b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:41.240856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021005fa-bfaa-427d-8fa8-a52876bda60b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:41.241132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021005fa-bfaa-427d-8fa8-a52876bda60b None admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:41.241954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021005fa-bfaa-427d-8fa8-a52876bda60b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:41.242260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021005fa-bfaa-427d-8fa8-a52876bda60b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:41.243682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021005fa-bfaa-427d-8fa8-a52876bda60b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:41.252660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:41.261135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 636/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jun 20 06:03:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:41.266563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97088012-a684-4672-a557-23ed96f7abbe None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:41.364388 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97088012-a684-4672-a557-23ed96f7abbe None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:41.403016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ccb7b-ac64-4d9c-9de9-94dfc56ad9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:41.403834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ccb7b-ac64-4d9c-9de9-94dfc56ad9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:41.404122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ccb7b-ac64-4d9c-9de9-94dfc56ad9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:41.404408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ccb7b-ac64-4d9c-9de9-94dfc56ad9b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:41.416707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ccb7b-ac64-4d9c-9de9-94dfc56ad9b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:41.418160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ccb7b-ac64-4d9c-9de9-94dfc56ad9b2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-692ccb7b-ac64-4d9c-9de9-94dfc56ad9b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:41.435301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:41.436362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:41.437349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:41.437349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:41.437349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:41.437349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:41.437349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 633/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:41.442296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021005fa-bfaa-427d-8fa8-a52876bda60b None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:41.540898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021005fa-bfaa-427d-8fa8-a52876bda60b None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:41.573287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258ad68-5ea1-4a87-9992-94509987e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:41.573940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ad68-5ea1-4a87-9992-94509987e7ef None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:41.574227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ad68-5ea1-4a87-9992-94509987e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:41.574506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ad68-5ea1-4a87-9992-94509987e7ef None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:41.575226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258ad68-5ea1-4a87-9992-94509987e7ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:41.575537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258ad68-5ea1-4a87-9992-94509987e7ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:41.576943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258ad68-5ea1-4a87-9992-94509987e7ef None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:41.588600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 637/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:41.594038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ccb7b-ac64-4d9c-9de9-94dfc56ad9b2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:41.630759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:41.699021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ccb7b-ac64-4d9c-9de9-94dfc56ad9b2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:41.732235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c39fbc-cd46-49e9-ad89-6f719299260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:41.733050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c39fbc-cd46-49e9-ad89-6f719299260e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:41.733339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c39fbc-cd46-49e9-ad89-6f719299260e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:41.733620 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c39fbc-cd46-49e9-ad89-6f719299260e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:41.740858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c39fbc-cd46-49e9-ad89-6f719299260e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:41.742306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c39fbc-cd46-49e9-ad89-6f719299260e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-66c39fbc-cd46-49e9-ad89-6f719299260e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:03:41.756277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:41.757371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:41.758333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:03:41.758333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:03:41.758333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:03:41.758333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:03:41.758333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:03:41.758333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:03:41.758333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:41.758333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:41.758333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 634/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:41.763281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258ad68-5ea1-4a87-9992-94509987e7ef None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:41.822485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:41.863955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258ad68-5ea1-4a87-9992-94509987e7ef None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:41.896079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c34d0-ad83-4dd3-8918-ec24c40c907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:41.896692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c34d0-ad83-4dd3-8918-ec24c40c907c None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:41.896981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c34d0-ad83-4dd3-8918-ec24c40c907c None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:41.897261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c34d0-ad83-4dd3-8918-ec24c40c907c None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:41.898041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c34d0-ad83-4dd3-8918-ec24c40c907c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:41.898355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c34d0-ad83-4dd3-8918-ec24c40c907c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:41.899776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c34d0-ad83-4dd3-8918-ec24c40c907c None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:41.912206 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 638/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:03:41.918003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c39fbc-cd46-49e9-ad89-6f719299260e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:42.029063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:42.038399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c39fbc-cd46-49e9-ad89-6f719299260e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:42.071352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874498cf-0ef7-4155-9fcc-a04aed7c304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:42.072223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874498cf-0ef7-4155-9fcc-a04aed7c304f None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:42.072507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874498cf-0ef7-4155-9fcc-a04aed7c304f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:42.072812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874498cf-0ef7-4155-9fcc-a04aed7c304f None admin] PATH_INFO: `/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/577f89ef22954926bdf02a15484f8f17/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:42.074720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874498cf-0ef7-4155-9fcc-a04aed7c304f None admin] RBAC: Authorizing `identity:create_grant(project_id=c57a2daa2948400ea8175d6aea22a68e, user_id=577f89ef22954926bdf02a15484f8f17, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:42.076139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874498cf-0ef7-4155-9fcc-a04aed7c304f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:42.088649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 635/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jun 20 06:03:41 2022] PUT /identity/v3/projects/c57a2daa2948400ea8175d6aea22a68e/users/577f89ef22954926bdf02a15484f8f17/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:03:44.121719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460ec6-e0bb-483c-b65d-1f352859e652 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:44.122304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460ec6-e0bb-483c-b65d-1f352859e652 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:44.122304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e460ec6-e0bb-483c-b65d-1f352859e652 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:44.123662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 639/1274] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:44.129040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f6c5-0715-46e8-a63e-9391b73e66e5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:44.129491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f6c5-0715-46e8-a63e-9391b73e66e5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:44.129593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f6c5-0715-46e8-a63e-9391b73e66e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:44.145885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1ac1f6c5-0715-46e8-a63e-9391b73e66e5 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:44.147082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1ac1f6c5-0715-46e8-a63e-9391b73e66e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:44.212123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 636/1275] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:03:44.235620 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e460ec6-e0bb-483c-b65d-1f352859e652 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:44.338598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e460ec6-e0bb-483c-b65d-1f352859e652 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:44.360696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:44.380075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62d61d-0ec6-4800-b30e-ba30933a357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:44.381023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62d61d-0ec6-4800-b30e-ba30933a357d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:44.381375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62d61d-0ec6-4800-b30e-ba30933a357d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:44.381733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62d61d-0ec6-4800-b30e-ba30933a357d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:44.394371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62d61d-0ec6-4800-b30e-ba30933a357d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-cd62d61d-0ec6-4800-b30e-ba30933a357d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 06:03:44.402460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:44.403672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:44.404872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 640/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jun 20 06:03:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:44.410643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1f6c5-0715-46e8-a63e-9391b73e66e5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:44.490360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:44.509137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1f6c5-0715-46e8-a63e-9391b73e66e5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:44.543191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fed69-6b8c-44d4-9987-303f0b9cb36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:44.543841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fed69-6b8c-44d4-9987-303f0b9cb36a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:44.544125 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fed69-6b8c-44d4-9987-303f0b9cb36a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:44.544402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fed69-6b8c-44d4-9987-303f0b9cb36a None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:44.545170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fed69-6b8c-44d4-9987-303f0b9cb36a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:44.545477 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fed69-6b8c-44d4-9987-303f0b9cb36a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:44.546834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fed69-6b8c-44d4-9987-303f0b9cb36a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:44.554951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 637/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jun 20 06:03:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:44.560497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62d61d-0ec6-4800-b30e-ba30933a357d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:44.659651 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62d61d-0ec6-4800-b30e-ba30933a357d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:44.692349 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dfa7f-82e9-4b39-9b4b-6ff6539bb878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:44.693155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dfa7f-82e9-4b39-9b4b-6ff6539bb878 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:44.693438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dfa7f-82e9-4b39-9b4b-6ff6539bb878 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:44.693713 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dfa7f-82e9-4b39-9b4b-6ff6539bb878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:44.703990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dfa7f-82e9-4b39-9b4b-6ff6539bb878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:44.705563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dfa7f-82e9-4b39-9b4b-6ff6539bb878 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-ec1dfa7f-82e9-4b39-9b4b-6ff6539bb878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:44.722644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:44.723716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:44.725013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:44.725013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:44.725013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:44.725013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:44.725013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 641/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:44.729579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fed69-6b8c-44d4-9987-303f0b9cb36a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:44.827187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fed69-6b8c-44d4-9987-303f0b9cb36a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:44.860086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb4d6a-72b5-4388-a081-10316e871731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:44.860756 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4d6a-72b5-4388-a081-10316e871731 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:44.861041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4d6a-72b5-4388-a081-10316e871731 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:44.862368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4d6a-72b5-4388-a081-10316e871731 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:44.863087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb4d6a-72b5-4388-a081-10316e871731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:44.863395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb4d6a-72b5-4388-a081-10316e871731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:44.864781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb4d6a-72b5-4388-a081-10316e871731 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:44.875927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 638/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:44.882036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dfa7f-82e9-4b39-9b4b-6ff6539bb878 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:44.912510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:44.979904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dfa7f-82e9-4b39-9b4b-6ff6539bb878 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:45.012867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408efca-8824-4708-a950-ceaa187e5102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:45.013661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408efca-8824-4708-a950-ceaa187e5102 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:45.013949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408efca-8824-4708-a950-ceaa187e5102 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:45.014228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408efca-8824-4708-a950-ceaa187e5102 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:45.021827 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408efca-8824-4708-a950-ceaa187e5102 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:45.023260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408efca-8824-4708-a950-ceaa187e5102 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-6408efca-8824-4708-a950-ceaa187e5102 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 06:03:45.038321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:45.039456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:45.040847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:45.040847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:45.040847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 06:03:45.040847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 06:03:45.040847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 06:03:45.040847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 06:03:45.040847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 06:03:45.040847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 06:03:45.040847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 06:03:45.040847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:45.040847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 642/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:45.045174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb4d6a-72b5-4388-a081-10316e871731 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:45.049508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:45.143274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb4d6a-72b5-4388-a081-10316e871731 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:45.176754 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff705e-5acb-4445-ad40-ef220ed6b335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:45.177355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff705e-5acb-4445-ad40-ef220ed6b335 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:45.177640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff705e-5acb-4445-ad40-ef220ed6b335 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:45.177918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff705e-5acb-4445-ad40-ef220ed6b335 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:45.178747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff705e-5acb-4445-ad40-ef220ed6b335 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:45.179059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff705e-5acb-4445-ad40-ef220ed6b335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:45.180475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff705e-5acb-4445-ad40-ef220ed6b335 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:45.196747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 639/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jun 20 06:03:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:45.202364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408efca-8824-4708-a950-ceaa187e5102 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:45.291959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:45.301671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408efca-8824-4708-a950-ceaa187e5102 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:45.334136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b06634-b35c-4189-9d2b-99e1cc5bd6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:45.334775 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b06634-b35c-4189-9d2b-99e1cc5bd6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:45.335061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b06634-b35c-4189-9d2b-99e1cc5bd6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:45.335340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b06634-b35c-4189-9d2b-99e1cc5bd6a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:45.406494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b06634-b35c-4189-9d2b-99e1cc5bd6a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:45.407994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b06634-b35c-4189-9d2b-99e1cc5bd6a3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:45.495737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:45.506167 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 643/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jun 20 06:03:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 06:03:45.511933 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff705e-5acb-4445-ad40-ef220ed6b335 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:45.572969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:45.610569 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff705e-5acb-4445-ad40-ef220ed6b335 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:45.644940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d9d2-3c5b-4687-a7ec-41cd1dd2a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:45.645732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d9d2-3c5b-4687-a7ec-41cd1dd2a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:45.646017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d9d2-3c5b-4687-a7ec-41cd1dd2a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:45.646295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d9d2-3c5b-4687-a7ec-41cd1dd2a4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:45.656011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601d9d2-3c5b-4687-a7ec-41cd1dd2a4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:45.657489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601d9d2-3c5b-4687-a7ec-41cd1dd2a4b9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-a601d9d2-3c5b-4687-a7ec-41cd1dd2a4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 06:03:45.674725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:45.675798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:45.677027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 06:03:45.677027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 06:03:45.677027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 06:03:45.677027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:45.677027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 640/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:45.681553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b06634-b35c-4189-9d2b-99e1cc5bd6a3 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:45.779195 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b06634-b35c-4189-9d2b-99e1cc5bd6a3 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:45.812386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa35da5-9b95-4dc7-8505-0a4ac9b90b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:45.813065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35da5-9b95-4dc7-8505-0a4ac9b90b9d None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:45.813352 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35da5-9b95-4dc7-8505-0a4ac9b90b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:45.813628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35da5-9b95-4dc7-8505-0a4ac9b90b9d None admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:45.814933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35da5-9b95-4dc7-8505-0a4ac9b90b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:45.815247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35da5-9b95-4dc7-8505-0a4ac9b90b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:45.816822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35da5-9b95-4dc7-8505-0a4ac9b90b9d None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:45.827785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 644/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jun 20 06:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:45.833721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d9d2-3c5b-4687-a7ec-41cd1dd2a4b9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:45.931749 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d9d2-3c5b-4687-a7ec-41cd1dd2a4b9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:45.946270 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:45.975756 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eacb6d-615c-4204-bd1d-223176855e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:45.976552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eacb6d-615c-4204-bd1d-223176855e56 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:45.976860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eacb6d-615c-4204-bd1d-223176855e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:45.977137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eacb6d-615c-4204-bd1d-223176855e56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:45.983569 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eacb6d-615c-4204-bd1d-223176855e56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:45.985027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eacb6d-615c-4204-bd1d-223176855e56 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-a0eacb6d-615c-4204-bd1d-223176855e56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 06:03:45.999365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:46.000429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:46.001436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 06:03:46.001436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 06:03:46.001436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 06:03:46.001436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 06:03:46.001436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 06:03:46.001436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 06:03:46.001436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 06:03:46.001436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 20 06:03:46.001436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 641/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jun 20 06:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:46.007294 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa35da5-9b95-4dc7-8505-0a4ac9b90b9d None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:46.057201 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:46.106099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa35da5-9b95-4dc7-8505-0a4ac9b90b9d None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:46.139316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0b340-4656-4b86-9e5c-f42e6f6ceb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:46.139960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b340-4656-4b86-9e5c-f42e6f6ceb0b None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:46.140245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b340-4656-4b86-9e5c-f42e6f6ceb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:46.140527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b340-4656-4b86-9e5c-f42e6f6ceb0b None admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:46.141337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b340-4656-4b86-9e5c-f42e6f6ceb0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:46.141645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b340-4656-4b86-9e5c-f42e6f6ceb0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:46.143069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b340-4656-4b86-9e5c-f42e6f6ceb0b None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:46.154698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 645/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jun 20 06:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:46.160746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eacb6d-615c-4204-bd1d-223176855e56 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:46.258927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eacb6d-615c-4204-bd1d-223176855e56 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:46.291195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ef276-15a6-4e9d-945d-b55acdb89062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:46.291832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ef276-15a6-4e9d-945d-b55acdb89062 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:46.292120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ef276-15a6-4e9d-945d-b55acdb89062 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:46.292404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ef276-15a6-4e9d-945d-b55acdb89062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:46.293263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ef276-15a6-4e9d-945d-b55acdb89062 None admin] RBAC: Adding query filter params (role.id=efc16976111d431c9173186cbd0e6c24, scope.project.id=c57a2daa2948400ea8175d6aea22a68e, user.id=577f89ef22954926bdf02a15484f8f17) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:46.293578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ef276-15a6-4e9d-945d-b55acdb89062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:46.295006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ef276-15a6-4e9d-945d-b55acdb89062 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:46.301371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 642/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jun 20 06:03:46 2022] GET /identity/v3/role_assignments?user.id=577f89ef22954926bdf02a15484f8f17&scope.project.id=c57a2daa2948400ea8175d6aea22a68e&role.id=efc16976111d431c9173186cbd0e6c24 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:48.370573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef49a0d-3ec0-4f64-8505-1da79f4b5c1b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:48.371211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef49a0d-3ec0-4f64-8505-1da79f4b5c1b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:48.371211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef49a0d-3ec0-4f64-8505-1da79f4b5c1b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:48.372719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 646/1288] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:48.379129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b41ac0-b711-4df6-91a5-1b92e7b9f626 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:48.379645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b41ac0-b711-4df6-91a5-1b92e7b9f626 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:48.379862 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b41ac0-b711-4df6-91a5-1b92e7b9f626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:48.397238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f5b41ac0-b711-4df6-91a5-1b92e7b9f626 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:48.398437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f5b41ac0-b711-4df6-91a5-1b92e7b9f626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:48.431442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:48.469377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 643/1289] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:03:48.492521 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef49a0d-3ec0-4f64-8505-1da79f4b5c1b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:48.592284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef49a0d-3ec0-4f64-8505-1da79f4b5c1b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:48.603130 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:48.629428 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e4c3b-d84c-4068-8939-a900d03856c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:48.630234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4c3b-d84c-4068-8939-a900d03856c4 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:48.630520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4c3b-d84c-4068-8939-a900d03856c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:48.630800 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4c3b-d84c-4068-8939-a900d03856c4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:48.631463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e4c3b-d84c-4068-8939-a900d03856c4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:48.632895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e4c3b-d84c-4068-8939-a900d03856c4 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-100e4c3b-d84c-4068-8939-a900d03856c4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:48.644732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:48.645975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:48.647108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 647/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jun 20 06:03:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:48.651871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b41ac0-b711-4df6-91a5-1b92e7b9f626 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:48.748349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b41ac0-b711-4df6-91a5-1b92e7b9f626 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:48.781468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbbc6a-6c1f-4546-9814-1e7c9860d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:48.782116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbc6a-6c1f-4546-9814-1e7c9860d89d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:48.782405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbc6a-6c1f-4546-9814-1e7c9860d89d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:48.782686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbc6a-6c1f-4546-9814-1e7c9860d89d None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:48.784035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbbc6a-6c1f-4546-9814-1e7c9860d89d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:48.784349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbbc6a-6c1f-4546-9814-1e7c9860d89d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:48.785762 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbbc6a-6c1f-4546-9814-1e7c9860d89d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:48.790835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 644/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jun 20 06:03:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:48.796390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e4c3b-d84c-4068-8939-a900d03856c4 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:48.893822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e4c3b-d84c-4068-8939-a900d03856c4 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:48.926400 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9452b4-0164-4590-8b1a-6f923f665d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:48.927040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9452b4-0164-4590-8b1a-6f923f665d49 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:48.927323 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9452b4-0164-4590-8b1a-6f923f665d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:48.927598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9452b4-0164-4590-8b1a-6f923f665d49 None admin] PATH_INFO: `/v3/services` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:48.928298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9452b4-0164-4590-8b1a-6f923f665d49 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:48.928604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9452b4-0164-4590-8b1a-6f923f665d49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:48.930000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9452b4-0164-4590-8b1a-6f923f665d49 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:48.934289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 648/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jun 20 06:03:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:50.967432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef28e86-b537-47f8-889b-83d8f4d4d51c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:50.967949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef28e86-b537-47f8-889b-83d8f4d4d51c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:50.967949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef28e86-b537-47f8-889b-83d8f4d4d51c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:50.969325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 645/1293] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:50.974990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811d50f-4d41-483f-a0cc-8747063607eb None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:50.975421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811d50f-4d41-483f-a0cc-8747063607eb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:50.975598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811d50f-4d41-483f-a0cc-8747063607eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:50.992361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0811d50f-4d41-483f-a0cc-8747063607eb None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:50.993563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0811d50f-4d41-483f-a0cc-8747063607eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:51.021692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:51.059758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 649/1294] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:03:51.083923 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef28e86-b537-47f8-889b-83d8f4d4d51c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:51.114766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:51.183579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef28e86-b537-47f8-889b-83d8f4d4d51c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:51.216697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30697e7-fe13-4432-bdbe-5cdfe3daa415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:51.217345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30697e7-fe13-4432-bdbe-5cdfe3daa415 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:51.217677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30697e7-fe13-4432-bdbe-5cdfe3daa415 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:51.217906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30697e7-fe13-4432-bdbe-5cdfe3daa415 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:51.218630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30697e7-fe13-4432-bdbe-5cdfe3daa415 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:51.219985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30697e7-fe13-4432-bdbe-5cdfe3daa415 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:51.233151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 646/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jun 20 06:03:51 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:03:53.258970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6248ae6-c05a-4b4e-bf0b-232056911b1c None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:53.259501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6248ae6-c05a-4b4e-bf0b-232056911b1c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:53.259621 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6248ae6-c05a-4b4e-bf0b-232056911b1c None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:53.261027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 650/1296] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:53.266070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b141b21-2ad5-421f-bc8a-897341374eaf None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:53.266490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b141b21-2ad5-421f-bc8a-897341374eaf None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:53.266634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b141b21-2ad5-421f-bc8a-897341374eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:53.282928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0b141b21-2ad5-421f-bc8a-897341374eaf None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:53.284905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0b141b21-2ad5-421f-bc8a-897341374eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:53.355905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 647/1297] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:03:53.380066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6248ae6-c05a-4b4e-bf0b-232056911b1c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:53.487629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6248ae6-c05a-4b4e-bf0b-232056911b1c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:53.520657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d126aed-6db9-4257-88c5-d3a4e3ab1b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:53.521396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d126aed-6db9-4257-88c5-d3a4e3ab1b32 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:53.521687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d126aed-6db9-4257-88c5-d3a4e3ab1b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:53.521968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d126aed-6db9-4257-88c5-d3a4e3ab1b32 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:53.522625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d126aed-6db9-4257-88c5-d3a4e3ab1b32 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:53.524002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d126aed-6db9-4257-88c5-d3a4e3ab1b32 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-0d126aed-6db9-4257-88c5-d3a4e3ab1b32 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:53.536284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:53.537751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:53.538633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 651/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jun 20 06:03:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:53.543750 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b141b21-2ad5-421f-bc8a-897341374eaf None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:53.561519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:53.642021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b141b21-2ad5-421f-bc8a-897341374eaf None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:53.675990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8e64d-85ec-4b15-b7c5-e3cbe127f413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:53.676754 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e64d-85ec-4b15-b7c5-e3cbe127f413 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:53.677038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e64d-85ec-4b15-b7c5-e3cbe127f413 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:53.677315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e64d-85ec-4b15-b7c5-e3cbe127f413 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:53.678023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8e64d-85ec-4b15-b7c5-e3cbe127f413 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:53.678329 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8e64d-85ec-4b15-b7c5-e3cbe127f413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:53.679709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8e64d-85ec-4b15-b7c5-e3cbe127f413 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:53.684835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 648/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jun 20 06:03:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:53.691214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d126aed-6db9-4257-88c5-d3a4e3ab1b32 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:53.722799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:53.790980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d126aed-6db9-4257-88c5-d3a4e3ab1b32 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:53.823942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76c4b0-87a1-4d7e-870e-d49bc2f973da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:53.824590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c4b0-87a1-4d7e-870e-d49bc2f973da None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:53.824913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c4b0-87a1-4d7e-870e-d49bc2f973da None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:53.825196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c4b0-87a1-4d7e-870e-d49bc2f973da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:53.825986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c4b0-87a1-4d7e-870e-d49bc2f973da None admin] RBAC: Adding query filter params (interface=public, service_id=e4daeb135185407fa2c2c7f7f6553f92, region_id=RegionOne) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:53.826303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c4b0-87a1-4d7e-870e-d49bc2f973da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:53.827682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c4b0-87a1-4d7e-870e-d49bc2f973da None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:53.833386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 652/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jun 20 06:03:53 2022] GET /identity/v3/endpoints?service_id=e4daeb135185407fa2c2c7f7f6553f92&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:53.838909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8e64d-85ec-4b15-b7c5-e3cbe127f413 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:53.918080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:53.936478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8e64d-85ec-4b15-b7c5-e3cbe127f413 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:53.970667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73419826-f5b2-42f8-90a2-b6873e40ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:53.971309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73419826-f5b2-42f8-90a2-b6873e40ad3f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:53.971596 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73419826-f5b2-42f8-90a2-b6873e40ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:53.971873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73419826-f5b2-42f8-90a2-b6873e40ad3f None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:53.972553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73419826-f5b2-42f8-90a2-b6873e40ad3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:53.973952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73419826-f5b2-42f8-90a2-b6873e40ad3f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:53.980680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 649/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jun 20 06:03:53 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:03:55.990092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02021a3f-559c-47f5-8a7d-45ddbbcef590 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:55.990605 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02021a3f-559c-47f5-8a7d-45ddbbcef590 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:55.990605 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02021a3f-559c-47f5-8a7d-45ddbbcef590 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:55.991943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 653/1302] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:55.996964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f1be4-c209-4690-9d94-d617fd280c2c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:55.997397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f1be4-c209-4690-9d94-d617fd280c2c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:55.997519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f1be4-c209-4690-9d94-d617fd280c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:56.013719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-584f1be4-c209-4690-9d94-d617fd280c2c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:56.014889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-584f1be4-c209-4690-9d94-d617fd280c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:56.082634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 650/1303] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:03:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 06:03:56.105768 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02021a3f-559c-47f5-8a7d-45ddbbcef590 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:56.201068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:56.209274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02021a3f-559c-47f5-8a7d-45ddbbcef590 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:56.242633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83abeeb-6ae2-4117-b14d-910158712b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:56.243355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83abeeb-6ae2-4117-b14d-910158712b99 None admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:56.243637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83abeeb-6ae2-4117-b14d-910158712b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:56.243912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83abeeb-6ae2-4117-b14d-910158712b99 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:56.244557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83abeeb-6ae2-4117-b14d-910158712b99 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:56.245959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83abeeb-6ae2-4117-b14d-910158712b99 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application [None req-d83abeeb-6ae2-4117-b14d-910158712b99 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 06:03:56.258485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 06:03:56.259669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application with Lock( Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self._enter() Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application return self.creator() Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application created_value = creator( Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: ERROR keystone.server.flask.application Jun 20 06:03:56.260764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 654/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jun 20 06:03:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 06:03:56.265660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f1be4-c209-4690-9d94-d617fd280c2c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:56.340953 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:56.364124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f1be4-c209-4690-9d94-d617fd280c2c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:56.409605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555c4f0-bad2-478f-834f-44897ec8feab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:56.410406 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c4f0-bad2-478f-834f-44897ec8feab None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:56.410692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c4f0-bad2-478f-834f-44897ec8feab None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:56.410969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c4f0-bad2-478f-834f-44897ec8feab None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:56.411683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555c4f0-bad2-478f-834f-44897ec8feab None admin] RBAC: Adding query filter params (name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:56.411990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555c4f0-bad2-478f-834f-44897ec8feab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:56.413652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555c4f0-bad2-478f-834f-44897ec8feab None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:56.419020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 651/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jun 20 06:03:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:56.425650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83abeeb-6ae2-4117-b14d-910158712b99 None admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:56.523215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83abeeb-6ae2-4117-b14d-910158712b99 None admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:56.555827 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b624c-5559-4628-9cdc-4116ad154bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:56.556469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b624c-5559-4628-9cdc-4116ad154bd3 None admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:56.556786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b624c-5559-4628-9cdc-4116ad154bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:56.557070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b624c-5559-4628-9cdc-4116ad154bd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:56.557813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b624c-5559-4628-9cdc-4116ad154bd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:56.559207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b624c-5559-4628-9cdc-4116ad154bd3 None admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:56.577300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 655/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jun 20 06:03:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:04:06.416254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=30 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:06.572842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:00.005310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2d3ad-b890-42d2-a4ce-4b5c1f929435 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:00.005770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2d3ad-b890-42d2-a4ce-4b5c1f929435 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:00.005770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2d3ad-b890-42d2-a4ce-4b5c1f929435 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:00.010953 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 652/1307] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:00.012437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a42145-6600-4f9d-a44e-c3d73f89481c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:00.013039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a42145-6600-4f9d-a44e-c3d73f89481c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:00.013039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a42145-6600-4f9d-a44e-c3d73f89481c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:00.182556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-49a42145-6600-4f9d-a44e-c3d73f89481c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:00.186666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-49a42145-6600-4f9d-a44e-c3d73f89481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:00.339171 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 656/1308] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:00.391152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ac766-b89b-4456-8ba5-51dcbcb86e57 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:00.391538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ac766-b89b-4456-8ba5-51dcbcb86e57 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:00.391920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ac766-b89b-4456-8ba5-51dcbcb86e57 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:00.393810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 653/1309] 10.222.0.40 () {54 vars in 964 bytes} [Mon Jun 20 06:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:00.399825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b189-d98d-48f7-bc46-eed36bbb505b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:00.400469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b189-d98d-48f7-bc46-eed36bbb505b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:00.400974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b189-d98d-48f7-bc46-eed36bbb505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:00.491607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7b01b189-d98d-48f7-bc46-eed36bbb505b None None] MFA Rules not processed for user `9d21089ce5b140ab9549816b8cb38316`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:00.493305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7b01b189-d98d-48f7-bc46-eed36bbb505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:00.515774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:00.578172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 657/1310] 10.222.0.40 () {58 vars in 1061 bytes} [Mon Jun 20 06:05:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:00.587694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ac766-b89b-4456-8ba5-51dcbcb86e57 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:00.589710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ab6ac766-b89b-4456-8ba5-51dcbcb86e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:00.717857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ac766-b89b-4456-8ba5-51dcbcb86e57 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:00.798500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1146d51-aeaa-4039-8b4c-9280ef00265b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:00.799201 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146d51-aeaa-4039-8b4c-9280ef00265b service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:00.799544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146d51-aeaa-4039-8b4c-9280ef00265b service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:00.799748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146d51-aeaa-4039-8b4c-9280ef00265b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:00.801590 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b1146d51-aeaa-4039-8b4c-9280ef00265b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:00.858434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:00.924789 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1146d51-aeaa-4039-8b4c-9280ef00265b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:00.926253 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1146d51-aeaa-4039-8b4c-9280ef00265b service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:00.948092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 654/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:03.274963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbec739-41e6-477a-851b-d1e8f4ab52ef None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:03.275493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbec739-41e6-477a-851b-d1e8f4ab52ef None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:03.275493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbec739-41e6-477a-851b-d1e8f4ab52ef None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:03.276929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 658/1312] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:03.282076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3428f05-fe07-405d-bcbc-411f618402b1 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:03.282494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3428f05-fe07-405d-bcbc-411f618402b1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:03.282635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3428f05-fe07-405d-bcbc-411f618402b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:03.379845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f3428f05-fe07-405d-bcbc-411f618402b1 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:03.381158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f3428f05-fe07-405d-bcbc-411f618402b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:03.500540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 655/1313] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:03.540168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbec739-41e6-477a-851b-d1e8f4ab52ef None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:03.541819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0bbec739-41e6-477a-851b-d1e8f4ab52ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:03.659567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbec739-41e6-477a-851b-d1e8f4ab52ef None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:03.741853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:03.744869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab0555-145c-4c5c-a029-69d0c1caeba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:03.745740 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab0555-145c-4c5c-a029-69d0c1caeba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:03.746040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab0555-145c-4c5c-a029-69d0c1caeba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:03.746518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab0555-145c-4c5c-a029-69d0c1caeba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:03.748191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c9ab0555-145c-4c5c-a029-69d0c1caeba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:03.859084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab0555-145c-4c5c-a029-69d0c1caeba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:03.860580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab0555-145c-4c5c-a029-69d0c1caeba9 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:03.880537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 659/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:06.222260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3b553-8d01-4d93-bee1-a269c90d506f None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:06.222798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3b553-8d01-4d93-bee1-a269c90d506f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:06.222896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3b553-8d01-4d93-bee1-a269c90d506f None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:06.224214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 656/1315] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:06.229510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdfbfc-579a-4faf-8c22-99ac271a625e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:06.229929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdfbfc-579a-4faf-8c22-99ac271a625e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:06.230083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdfbfc-579a-4faf-8c22-99ac271a625e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:06.294984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e1fdfbfc-579a-4faf-8c22-99ac271a625e None None] MFA Rules not processed for user `5b5a1eff07f9401787ed37895a56aafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:06.296163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e1fdfbfc-579a-4faf-8c22-99ac271a625e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:06.348048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:06.392596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 660/1316] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:06.432301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3b553-8d01-4d93-bee1-a269c90d506f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:06.433889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2ee3b553-8d01-4d93-bee1-a269c90d506f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:06.444098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:06.542846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3b553-8d01-4d93-bee1-a269c90d506f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:06.614160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7f10c-dea0-46b1-81f2-6e9aef138c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:06.614802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f10c-dea0-46b1-81f2-6e9aef138c6f service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:06.615087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f10c-dea0-46b1-81f2-6e9aef138c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:06.615368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f10c-dea0-46b1-81f2-6e9aef138c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:06.617041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-04b7f10c-dea0-46b1-81f2-6e9aef138c6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:06.678026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:06.723875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7f10c-dea0-46b1-81f2-6e9aef138c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:06.725339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7f10c-dea0-46b1-81f2-6e9aef138c6f service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:06.743612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 657/1317] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:09.302121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d984e53-ce58-456a-a41a-1136bb8fc45b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:09.302662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d984e53-ce58-456a-a41a-1136bb8fc45b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:09.302662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d984e53-ce58-456a-a41a-1136bb8fc45b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:09.304051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 661/1318] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:09.309173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e2ab-287a-4103-a532-924eba416d2e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:09.309627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e2ab-287a-4103-a532-924eba416d2e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:09.309773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e2ab-287a-4103-a532-924eba416d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:09.374231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d368e2ab-287a-4103-a532-924eba416d2e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:09.375457 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d368e2ab-287a-4103-a532-924eba416d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:09.473784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 658/1319] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:09.513297 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d984e53-ce58-456a-a41a-1136bb8fc45b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:09.514812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4d984e53-ce58-456a-a41a-1136bb8fc45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:09.617282 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d984e53-ce58-456a-a41a-1136bb8fc45b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:09.692630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825ea4e-f677-4dcb-8655-a00b3b913d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:09.693274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ea4e-f677-4dcb-8655-a00b3b913d73 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:09.693562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ea4e-f677-4dcb-8655-a00b3b913d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:09.693839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ea4e-f677-4dcb-8655-a00b3b913d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:09.695488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d825ea4e-f677-4dcb-8655-a00b3b913d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:09.702813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:09.804260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825ea4e-f677-4dcb-8655-a00b3b913d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:09.805747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825ea4e-f677-4dcb-8655-a00b3b913d73 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:09.824064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 662/1320] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:12.531792 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2122ef-fa77-48d6-bdb7-df387fc9b7ed None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:12.532332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2122ef-fa77-48d6-bdb7-df387fc9b7ed None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:12.532456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2122ef-fa77-48d6-bdb7-df387fc9b7ed None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:12.533959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 659/1321] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:12.539529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f74c6-4cf9-41f0-811f-ade28ccd4ded None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:12.539961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f74c6-4cf9-41f0-811f-ade28ccd4ded None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:12.540210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f74c6-4cf9-41f0-811f-ade28ccd4ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:12.607644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8f4f74c6-4cf9-41f0-811f-ade28ccd4ded None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:12.608864 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8f4f74c6-4cf9-41f0-811f-ade28ccd4ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:12.669573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:12.715044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 663/1322] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:12.758864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2122ef-fa77-48d6-bdb7-df387fc9b7ed None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:12.760415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ce2122ef-fa77-48d6-bdb7-df387fc9b7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:12.780122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:12.873982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2122ef-fa77-48d6-bdb7-df387fc9b7ed None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:12.950869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ef07d-2ca2-4eb9-bb29-6a82b4ede5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:12.951522 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ef07d-2ca2-4eb9-bb29-6a82b4ede5fc service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:12.951809 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ef07d-2ca2-4eb9-bb29-6a82b4ede5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:12.952085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ef07d-2ca2-4eb9-bb29-6a82b4ede5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:12.953772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-637ef07d-2ca2-4eb9-bb29-6a82b4ede5fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:13.026858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:13.064535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ef07d-2ca2-4eb9-bb29-6a82b4ede5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:13.066544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ef07d-2ca2-4eb9-bb29-6a82b4ede5fc service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:13.084312 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 660/1323] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:15.182505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d17191-7fe9-41b7-8c2b-6218b345e58b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:15.183015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d17191-7fe9-41b7-8c2b-6218b345e58b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:15.183015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d17191-7fe9-41b7-8c2b-6218b345e58b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:15.184662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 664/1324] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:15.190345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ae773-3f44-444a-a642-d4153742d11d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:15.190738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ae773-3f44-444a-a642-d4153742d11d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:15.190910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ae773-3f44-444a-a642-d4153742d11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:15.255854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c98ae773-3f44-444a-a642-d4153742d11d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:15.257087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c98ae773-3f44-444a-a642-d4153742d11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:15.352416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 661/1325] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:15.402721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adcdb9-eb2e-4cf0-ab0e-b3d59e1c3d2f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:15.403012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adcdb9-eb2e-4cf0-ab0e-b3d59e1c3d2f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:15.403295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adcdb9-eb2e-4cf0-ab0e-b3d59e1c3d2f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:15.404712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 665/1326] 10.222.0.40 () {54 vars in 964 bytes} [Mon Jun 20 06:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:15.411190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7a458-7ab3-4f18-84e5-0fb68a84987f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:15.411548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7a458-7ab3-4f18-84e5-0fb68a84987f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:15.411921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7a458-7ab3-4f18-84e5-0fb68a84987f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:15.442175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:15.486217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-12b7a458-7ab3-4f18-84e5-0fb68a84987f None None] MFA Rules not processed for user `9d21089ce5b140ab9549816b8cb38316`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:15.488000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-12b7a458-7ab3-4f18-84e5-0fb68a84987f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:15.577418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 662/1327] 10.222.0.40 () {58 vars in 1061 bytes} [Mon Jun 20 06:05:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:15.587070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adcdb9-eb2e-4cf0-ab0e-b3d59e1c3d2f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:15.588684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-71adcdb9-eb2e-4cf0-ab0e-b3d59e1c3d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:15.701574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adcdb9-eb2e-4cf0-ab0e-b3d59e1c3d2f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:15.787909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a75a29-fe1f-41a9-b8b7-f6245d7cd660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:15.788600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a75a29-fe1f-41a9-b8b7-f6245d7cd660 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:15.788927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a75a29-fe1f-41a9-b8b7-f6245d7cd660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:15.789214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a75a29-fe1f-41a9-b8b7-f6245d7cd660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:15.791187 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-59a75a29-fe1f-41a9-b8b7-f6245d7cd660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:15.809467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:15.907163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a75a29-fe1f-41a9-b8b7-f6245d7cd660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:15.908709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a75a29-fe1f-41a9-b8b7-f6245d7cd660 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:15.927390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 666/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:18.303739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122393-6c7b-4cea-9204-f0f71c06e1e5 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:18.304287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122393-6c7b-4cea-9204-f0f71c06e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:18.304287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122393-6c7b-4cea-9204-f0f71c06e1e5 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:18.305736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 663/1329] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:18.310883 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac469-f531-4366-854c-19814fa1a1aa None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:18.311317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac469-f531-4366-854c-19814fa1a1aa None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:18.311426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac469-f531-4366-854c-19814fa1a1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:18.396962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-de4ac469-f531-4366-854c-19814fa1a1aa None None] MFA Rules not processed for user `5b5a1eff07f9401787ed37895a56aafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:18.398203 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-de4ac469-f531-4366-854c-19814fa1a1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:18.467006 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:18.500342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 667/1330] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:18.538052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee122393-6c7b-4cea-9204-f0f71c06e1e5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:18.539848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ee122393-6c7b-4cea-9204-f0f71c06e1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:18.646484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee122393-6c7b-4cea-9204-f0f71c06e1e5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:18.666770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:18.722176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6541a8-93c3-48ca-8c8f-f6adf8c9b7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:18.722848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6541a8-93c3-48ca-8c8f-f6adf8c9b7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:18.723142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6541a8-93c3-48ca-8c8f-f6adf8c9b7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:18.723943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6541a8-93c3-48ca-8c8f-f6adf8c9b7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:18.725692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3e6541a8-93c3-48ca-8c8f-f6adf8c9b7f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:18.834568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6541a8-93c3-48ca-8c8f-f6adf8c9b7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:18.835994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6541a8-93c3-48ca-8c8f-f6adf8c9b7f2 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:18.856108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 664/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:21.326700 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efee66-6f64-4169-b20f-122c7e3d35a8 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:21.327270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efee66-6f64-4169-b20f-122c7e3d35a8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:21.327270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efee66-6f64-4169-b20f-122c7e3d35a8 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:21.328711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 668/1332] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:21.334416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d8453-afa2-464a-96e7-6256ac94b13a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:21.334851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d8453-afa2-464a-96e7-6256ac94b13a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:21.334961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d8453-afa2-464a-96e7-6256ac94b13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:21.397492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:21.400453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-750d8453-afa2-464a-96e7-6256ac94b13a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:21.402215 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-750d8453-afa2-464a-96e7-6256ac94b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:21.498168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 665/1333] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:21.535147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efee66-6f64-4169-b20f-122c7e3d35a8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:21.536706 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-69efee66-6f64-4169-b20f-122c7e3d35a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:21.639485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efee66-6f64-4169-b20f-122c7e3d35a8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:21.711082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944bc74-b623-44df-a88c-40da466f755f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:21.711724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944bc74-b623-44df-a88c-40da466f755f service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:21.712003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944bc74-b623-44df-a88c-40da466f755f service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:21.712277 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944bc74-b623-44df-a88c-40da466f755f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:21.713941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e944bc74-b623-44df-a88c-40da466f755f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:21.746991 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:21.839150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944bc74-b623-44df-a88c-40da466f755f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:21.840686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944bc74-b623-44df-a88c-40da466f755f service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:21.860422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 669/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:23.960136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de960e53-582b-4696-91b8-4afd432786b8 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:23.960670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de960e53-582b-4696-91b8-4afd432786b8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:23.960670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de960e53-582b-4696-91b8-4afd432786b8 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:23.962055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 666/1335] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:23.967128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc725de-addb-4f7d-a130-553bca67ebae None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:23.967525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc725de-addb-4f7d-a130-553bca67ebae None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:23.967698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc725de-addb-4f7d-a130-553bca67ebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:24.032042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2fc725de-addb-4f7d-a130-553bca67ebae None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:24.033270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2fc725de-addb-4f7d-a130-553bca67ebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:24.107344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:24.131129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 670/1336] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:24.171118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de960e53-582b-4696-91b8-4afd432786b8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:24.172740 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-de960e53-582b-4696-91b8-4afd432786b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:24.274231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de960e53-582b-4696-91b8-4afd432786b8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:24.305276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:24.350268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10630131-f6dc-4574-bea6-32428e345f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:24.350979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10630131-f6dc-4574-bea6-32428e345f4c service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:24.351265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10630131-f6dc-4574-bea6-32428e345f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:24.351571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10630131-f6dc-4574-bea6-32428e345f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:24.353234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-10630131-f6dc-4574-bea6-32428e345f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:24.461109 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10630131-f6dc-4574-bea6-32428e345f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:24.462545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10630131-f6dc-4574-bea6-32428e345f4c service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:24.480782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 667/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:26.958817 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46152b-f6f8-453d-82b6-71a76b7a3fa9 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:26.959392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46152b-f6f8-453d-82b6-71a76b7a3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:26.959392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46152b-f6f8-453d-82b6-71a76b7a3fa9 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:26.960827 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 671/1338] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:26.966036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a389a0a-dae1-4b6e-a8e1-082bc9f04379 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:26.966466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a389a0a-dae1-4b6e-a8e1-082bc9f04379 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:26.966602 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a389a0a-dae1-4b6e-a8e1-082bc9f04379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:27.029605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7a389a0a-dae1-4b6e-a8e1-082bc9f04379 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:27.030798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7a389a0a-dae1-4b6e-a8e1-082bc9f04379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:27.039402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:27.128145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 668/1339] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:27.165325 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46152b-f6f8-453d-82b6-71a76b7a3fa9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:27.166849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-db46152b-f6f8-453d-82b6-71a76b7a3fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:27.272268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46152b-f6f8-453d-82b6-71a76b7a3fa9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:27.344808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a59f2-83ad-4054-8c39-6a9489151cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:27.345462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a59f2-83ad-4054-8c39-6a9489151cbc service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:27.345749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a59f2-83ad-4054-8c39-6a9489151cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:27.346028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a59f2-83ad-4054-8c39-6a9489151cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:27.347833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-856a59f2-83ad-4054-8c39-6a9489151cbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:27.383669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:27.462682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a59f2-83ad-4054-8c39-6a9489151cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:27.464140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a59f2-83ad-4054-8c39-6a9489151cbc service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:27.482012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 672/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:31.441308 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0f42-a55a-491c-af5c-86f73e2b06b6 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:31.441856 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0f42-a55a-491c-af5c-86f73e2b06b6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:31.441960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0f42-a55a-491c-af5c-86f73e2b06b6 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:31.443346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 669/1341] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:31.448544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9ea26-1647-482a-9022-1c59d1d0d3d1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:31.448982 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9ea26-1647-482a-9022-1c59d1d0d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:31.449142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9ea26-1647-482a-9022-1c59d1d0d3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:31.526073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-82a9ea26-1647-482a-9022-1c59d1d0d3d1 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:31.527294 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-82a9ea26-1647-482a-9022-1c59d1d0d3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:31.628082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:31.638784 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 673/1342] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:31.678365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab0f42-a55a-491c-af5c-86f73e2b06b6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:31.680514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-dcab0f42-a55a-491c-af5c-86f73e2b06b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:31.783351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab0f42-a55a-491c-af5c-86f73e2b06b6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:31.787203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da354d2-eb77-4a9c-8bdf-73089a3e6b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:31.787993 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da354d2-eb77-4a9c-8bdf-73089a3e6b01 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:31.788285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da354d2-eb77-4a9c-8bdf-73089a3e6b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:31.788567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da354d2-eb77-4a9c-8bdf-73089a3e6b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:31.798442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da354d2-eb77-4a9c-8bdf-73089a3e6b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:31.799883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da354d2-eb77-4a9c-8bdf-73089a3e6b01 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:31.810138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 670/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:34.478944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81636be9-b862-4ac2-9e2f-3b37433a8df8 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:34.479494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81636be9-b862-4ac2-9e2f-3b37433a8df8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:34.479494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81636be9-b862-4ac2-9e2f-3b37433a8df8 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:34.480947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 674/1344] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:34.486439 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab2dc5-e4d2-44b2-a744-9be6b06a95cb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:34.486873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab2dc5-e4d2-44b2-a744-9be6b06a95cb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:34.487056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab2dc5-e4d2-44b2-a744-9be6b06a95cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:34.516199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-dcab2dc5-e4d2-44b2-a744-9be6b06a95cb None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:34.517439 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-dcab2dc5-e4d2-44b2-a744-9be6b06a95cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:34.545790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:34.607709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 671/1345] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:34.646781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81636be9-b862-4ac2-9e2f-3b37433a8df8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:34.648518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-81636be9-b862-4ac2-9e2f-3b37433a8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:34.662507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81636be9-b862-4ac2-9e2f-3b37433a8df8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:34.666446 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97ee06-7cc8-4202-a82d-fed9bf66c3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:34.667115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ee06-7cc8-4202-a82d-fed9bf66c3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:34.667404 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ee06-7cc8-4202-a82d-fed9bf66c3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:34.667686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ee06-7cc8-4202-a82d-fed9bf66c3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:34.678441 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97ee06-7cc8-4202-a82d-fed9bf66c3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:34.679948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97ee06-7cc8-4202-a82d-fed9bf66c3a2 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:34.690568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 675/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:05:39.065179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb8679-b1fe-456b-93dc-48fc88571c79 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:39.065675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb8679-b1fe-456b-93dc-48fc88571c79 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:39.065675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb8679-b1fe-456b-93dc-48fc88571c79 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:39.068303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 672/1347] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:39.073459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a2dca-725a-4560-973d-a0c601ab5bf3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:39.073906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a2dca-725a-4560-973d-a0c601ab5bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:39.074020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a2dca-725a-4560-973d-a0c601ab5bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:39.092602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-208a2dca-725a-4560-973d-a0c601ab5bf3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:39.093839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-208a2dca-725a-4560-973d-a0c601ab5bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:39.102512 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 676/1348] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:39.141126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb8679-b1fe-456b-93dc-48fc88571c79 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:39.152860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb8679-b1fe-456b-93dc-48fc88571c79 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:39.156999 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40c3ce-0ac3-4d54-83f4-e5c1671cdf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:39.157637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40c3ce-0ac3-4d54-83f4-e5c1671cdf70 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:39.157918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40c3ce-0ac3-4d54-83f4-e5c1671cdf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:39.158189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40c3ce-0ac3-4d54-83f4-e5c1671cdf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:39.168162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40c3ce-0ac3-4d54-83f4-e5c1671cdf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:39.169628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40c3ce-0ac3-4d54-83f4-e5c1671cdf70 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:39.179624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 673/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:44.148943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4816fbe-1f66-45e5-91c2-c3998b2e1d46 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:44.149875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4816fbe-1f66-45e5-91c2-c3998b2e1d46 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:44.150363 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4816fbe-1f66-45e5-91c2-c3998b2e1d46 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:44.152064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 677/1350] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:44.157323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5fb2d-b2f3-4f63-8e7a-203a9c2cfe7e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:44.158083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5fb2d-b2f3-4f63-8e7a-203a9c2cfe7e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:44.158372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5fb2d-b2f3-4f63-8e7a-203a9c2cfe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:44.278415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b1c5fb2d-b2f3-4f63-8e7a-203a9c2cfe7e None None] MFA Rules not processed for user `577f89ef22954926bdf02a15484f8f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:44.280101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b1c5fb2d-b2f3-4f63-8e7a-203a9c2cfe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:44.362130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 674/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:05:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:48.653600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dac322-077a-4a1f-bd19-b9e32c687da0 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:48.654153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dac322-077a-4a1f-bd19-b9e32c687da0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:48.654153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dac322-077a-4a1f-bd19-b9e32c687da0 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:48.655527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 678/1352] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:48.661206 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633436b5-4480-4165-8c58-d94c90125610 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:48.661729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633436b5-4480-4165-8c58-d94c90125610 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:48.661995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633436b5-4480-4165-8c58-d94c90125610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:48.681338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-633436b5-4480-4165-8c58-d94c90125610 None None] MFA Rules not processed for user `577f89ef22954926bdf02a15484f8f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:48.682817 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-633436b5-4480-4165-8c58-d94c90125610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:48.691870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 675/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:05:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:49.087714 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=13 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:50.207517 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c92a26-1ca2-4501-9074-210b52f5dc64 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:50.208680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c92a26-1ca2-4501-9074-210b52f5dc64 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:50.208680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c92a26-1ca2-4501-9074-210b52f5dc64 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:50.209590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 679/1354] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:50.214579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b44eb-823f-402a-8eb1-797f9c3e7a66 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:50.214985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b44eb-823f-402a-8eb1-797f9c3e7a66 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:50.215147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b44eb-823f-402a-8eb1-797f9c3e7a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:50.233668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-680b44eb-823f-402a-8eb1-797f9c3e7a66 None None] MFA Rules not processed for user `577f89ef22954926bdf02a15484f8f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:50.234866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-680b44eb-823f-402a-8eb1-797f9c3e7a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:50.244448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 676/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:05:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:53.825627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bee994-4f55-4286-804a-33d39448baf4 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:53.826145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bee994-4f55-4286-804a-33d39448baf4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:53.826145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bee994-4f55-4286-804a-33d39448baf4 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:53.827667 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 680/1356] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:53.833962 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5a91-c7f0-4298-bfc9-112923679baa None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:53.836993 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5a91-c7f0-4298-bfc9-112923679baa None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:53.837488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5a91-c7f0-4298-bfc9-112923679baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:53.857464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a7bf5a91-c7f0-4298-bfc9-112923679baa None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:53.858651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a7bf5a91-c7f0-4298-bfc9-112923679baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:53.866592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 677/1357] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:53.926458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d615a-93e3-421f-b6ff-3fa44849f26b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:53.926754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d615a-93e3-421f-b6ff-3fa44849f26b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:53.927081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d615a-93e3-421f-b6ff-3fa44849f26b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:53.929085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 681/1358] 10.222.0.40 () {54 vars in 961 bytes} [Mon Jun 20 06:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:53.936973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc048-8842-460c-9316-37717e78459e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:53.937476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc048-8842-460c-9316-37717e78459e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:53.937913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc048-8842-460c-9316-37717e78459e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:53.983985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:53.992979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a7afc048-8842-460c-9316-37717e78459e None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:53.994163 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a7afc048-8842-460c-9316-37717e78459e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:54.080043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 678/1359] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Jun 20 06:05:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:54.087708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d615a-93e3-421f-b6ff-3fa44849f26b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:54.108044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d615a-93e3-421f-b6ff-3fa44849f26b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:54.113707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d91fb-f35a-4c26-b4c1-1c06e044d59e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:54.114352 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d91fb-f35a-4c26-b4c1-1c06e044d59e service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:54.114639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d91fb-f35a-4c26-b4c1-1c06e044d59e service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:54.114914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d91fb-f35a-4c26-b4c1-1c06e044d59e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:54.123716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d91fb-f35a-4c26-b4c1-1c06e044d59e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:54.125342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d91fb-f35a-4c26-b4c1-1c06e044d59e service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:54.136362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 682/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:56.403844 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24f80c-8e85-4588-a36f-62dc2d6be2c9 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:56.404422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24f80c-8e85-4588-a36f-62dc2d6be2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:56.404422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24f80c-8e85-4588-a36f-62dc2d6be2c9 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:56.405948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 679/1361] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:56.411778 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55971c84-a28a-42d1-af15-998907b2f149 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:56.412175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55971c84-a28a-42d1-af15-998907b2f149 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:56.412349 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55971c84-a28a-42d1-af15-998907b2f149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:56.431325 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-55971c84-a28a-42d1-af15-998907b2f149 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:56.432534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-55971c84-a28a-42d1-af15-998907b2f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:56.440655 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 683/1362] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:56.484820 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24f80c-8e85-4588-a36f-62dc2d6be2c9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:56.500048 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24f80c-8e85-4588-a36f-62dc2d6be2c9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:56.505640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38f966-566d-4fd2-a5af-f631ec7e4aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:56.506287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38f966-566d-4fd2-a5af-f631ec7e4aab service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:56.506578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38f966-566d-4fd2-a5af-f631ec7e4aab service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:56.506861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38f966-566d-4fd2-a5af-f631ec7e4aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:56.515378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38f966-566d-4fd2-a5af-f631ec7e4aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:56.517018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38f966-566d-4fd2-a5af-f631ec7e4aab service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:56.527992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 680/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:58.920434 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48a17-2332-45a6-8c11-02b647d9f36e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:58.921005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48a17-2332-45a6-8c11-02b647d9f36e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:58.921005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48a17-2332-45a6-8c11-02b647d9f36e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:58.922402 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 684/1364] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:58.928488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff954-bbc3-4c73-a33a-d410fe5084f8 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:58.928911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff954-bbc3-4c73-a33a-d410fe5084f8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:58.929234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ff954-bbc3-4c73-a33a-d410fe5084f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:58.946990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a74ff954-bbc3-4c73-a33a-d410fe5084f8 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:58.948171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a74ff954-bbc3-4c73-a33a-d410fe5084f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:58.956129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 681/1365] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:59.014016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167106d-9183-4c64-8db8-47b67c315fe3 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:59.014735 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167106d-9183-4c64-8db8-47b67c315fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:59.015118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167106d-9183-4c64-8db8-47b67c315fe3 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:59.016870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 685/1366] 10.222.0.40 () {54 vars in 961 bytes} [Mon Jun 20 06:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:59.023470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f40c6-31b9-4c29-8e3f-978fbc343144 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:59.024031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f40c6-31b9-4c29-8e3f-978fbc343144 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:59.024219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f40c6-31b9-4c29-8e3f-978fbc343144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:59.044777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a49f40c6-31b9-4c29-8e3f-978fbc343144 None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:59.046038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a49f40c6-31b9-4c29-8e3f-978fbc343144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:59.055919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 682/1367] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Jun 20 06:05:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:59.064276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167106d-9183-4c64-8db8-47b67c315fe3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:59.079315 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167106d-9183-4c64-8db8-47b67c315fe3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:59.085742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7b283-f805-4f89-8ea4-3e49c39c2c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:59.086748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7b283-f805-4f89-8ea4-3e49c39c2c65 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:59.087106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7b283-f805-4f89-8ea4-3e49c39c2c65 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:59.087450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7b283-f805-4f89-8ea4-3e49c39c2c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:59.095495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7b283-f805-4f89-8ea4-3e49c39c2c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:59.097188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7b283-f805-4f89-8ea4-3e49c39c2c65 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:59.107492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 686/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:01.253046 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332590e-704f-42ff-8d4f-c739e8c614d8 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:01.253606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332590e-704f-42ff-8d4f-c739e8c614d8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:01.253606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332590e-704f-42ff-8d4f-c739e8c614d8 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:01.255063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 683/1369] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:01.260341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb230-27f7-4dfc-9bc6-c9f30bb1561a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:01.260777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb230-27f7-4dfc-9bc6-c9f30bb1561a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:01.261008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb230-27f7-4dfc-9bc6-c9f30bb1561a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:01.280389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f5ffb230-27f7-4dfc-9bc6-c9f30bb1561a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:01.281663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f5ffb230-27f7-4dfc-9bc6-c9f30bb1561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:01.291953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 687/1370] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:01.336772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332590e-704f-42ff-8d4f-c739e8c614d8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:01.351841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332590e-704f-42ff-8d4f-c739e8c614d8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:01.357455 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0c10c-a777-4587-9d7f-1bc6d45751cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:01.358102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0c10c-a777-4587-9d7f-1bc6d45751cf service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:01.358382 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0c10c-a777-4587-9d7f-1bc6d45751cf service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:01.358775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0c10c-a777-4587-9d7f-1bc6d45751cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:01.368173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0c10c-a777-4587-9d7f-1bc6d45751cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:01.369854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0c10c-a777-4587-9d7f-1bc6d45751cf service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:01.379848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 684/1371] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:01.985816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d29e4-4ff7-4f45-b12e-176b6d668c3e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:01.986137 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d29e4-4ff7-4f45-b12e-176b6d668c3e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:01.986490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d29e4-4ff7-4f45-b12e-176b6d668c3e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:01.987956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 688/1372] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:06:01.993619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b047d-bf34-411f-9ddb-9d47ede487c0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:01.993985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b047d-bf34-411f-9ddb-9d47ede487c0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:01.994333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b047d-bf34-411f-9ddb-9d47ede487c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:02.012310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ef5b047d-bf34-411f-9ddb-9d47ede487c0 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:02.013753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ef5b047d-bf34-411f-9ddb-9d47ede487c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:02.022320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 685/1373] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:02.379611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca21d-519c-415c-8d41-4d010ead1777 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:02.379611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca21d-519c-415c-8d41-4d010ead1777 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:02.379611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca21d-519c-415c-8d41-4d010ead1777 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:02.382995 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 689/1374] 10.222.0.40 () {54 vars in 963 bytes} [Mon Jun 20 06:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:02.387962 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae345-e083-499c-aef1-69ad32c9b5dd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:02.388466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae345-e083-499c-aef1-69ad32c9b5dd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:02.388558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae345-e083-499c-aef1-69ad32c9b5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:02.444762 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-cc6ae345-e083-499c-aef1-69ad32c9b5dd None None] MFA Rules not processed for user `7071b87350864e478e848e7d3d66e33e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:02.446064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cc6ae345-e083-499c-aef1-69ad32c9b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:02.509627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 686/1375] 10.222.0.40 () {58 vars in 1060 bytes} [Mon Jun 20 06:06:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:02.517535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fca21d-519c-415c-8d41-4d010ead1777 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:02.529695 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fca21d-519c-415c-8d41-4d010ead1777 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:02.533593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a22ff-94a8-4730-81d0-0dfe7b25d352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:02.534353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a22ff-94a8-4730-81d0-0dfe7b25d352 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:02.534746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a22ff-94a8-4730-81d0-0dfe7b25d352 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:02.535420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a22ff-94a8-4730-81d0-0dfe7b25d352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:02.545366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a22ff-94a8-4730-81d0-0dfe7b25d352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:02.546927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a22ff-94a8-4730-81d0-0dfe7b25d352 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:02.558002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 690/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:03.517400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d67513-45c6-4529-a29d-10af2fd0c5a2 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:03.517938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d67513-45c6-4529-a29d-10af2fd0c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:03.517938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d67513-45c6-4529-a29d-10af2fd0c5a2 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:03.519507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 687/1377] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:03.524568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de232c-3bce-43b7-ae18-84114101c57a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:03.524982 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de232c-3bce-43b7-ae18-84114101c57a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:03.525127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de232c-3bce-43b7-ae18-84114101c57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:03.543749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a6de232c-3bce-43b7-ae18-84114101c57a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:03.544980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a6de232c-3bce-43b7-ae18-84114101c57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:03.553688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 691/1378] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:03.597077 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d67513-45c6-4529-a29d-10af2fd0c5a2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:03.611678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d67513-45c6-4529-a29d-10af2fd0c5a2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:03.617812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcac487-3e5a-419f-9e8e-371dfe82343a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:03.621779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcac487-3e5a-419f-9e8e-371dfe82343a service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:03.621779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcac487-3e5a-419f-9e8e-371dfe82343a service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:03.621779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcac487-3e5a-419f-9e8e-371dfe82343a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:03.630716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcac487-3e5a-419f-9e8e-371dfe82343a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:03.632336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcac487-3e5a-419f-9e8e-371dfe82343a service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:03.636389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:03.642962 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 688/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:05.737666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9673-3b9c-4168-aefa-d79bc947bc4f None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:05.738239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9673-3b9c-4168-aefa-d79bc947bc4f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:05.738239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9673-3b9c-4168-aefa-d79bc947bc4f None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:05.740270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 692/1380] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:05.745652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55ed2c-d40c-45a6-98ae-aa0cd2c39e9f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:05.746061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55ed2c-d40c-45a6-98ae-aa0cd2c39e9f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:05.746287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55ed2c-d40c-45a6-98ae-aa0cd2c39e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:05.764204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5c55ed2c-d40c-45a6-98ae-aa0cd2c39e9f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:05.765409 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5c55ed2c-d40c-45a6-98ae-aa0cd2c39e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:05.775625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 689/1381] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:05.823850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9673-3b9c-4168-aefa-d79bc947bc4f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:05.839862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9673-3b9c-4168-aefa-d79bc947bc4f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:05.845339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef53be-fc8c-49ff-8f20-4da12b8dafab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:05.845983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef53be-fc8c-49ff-8f20-4da12b8dafab service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:05.846272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef53be-fc8c-49ff-8f20-4da12b8dafab service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:05.846556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef53be-fc8c-49ff-8f20-4da12b8dafab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:05.855649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef53be-fc8c-49ff-8f20-4da12b8dafab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:05.857286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef53be-fc8c-49ff-8f20-4da12b8dafab service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:05.867204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 693/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:07.964665 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c1ef-6e79-41ad-af27-315ab282ecba None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:07.965236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c1ef-6e79-41ad-af27-315ab282ecba None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:07.965236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c1ef-6e79-41ad-af27-315ab282ecba None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:07.966606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 690/1383] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:07.971854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad793093-2d26-4dfc-a4c2-49dfe912998e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:07.972261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad793093-2d26-4dfc-a4c2-49dfe912998e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:07.972436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad793093-2d26-4dfc-a4c2-49dfe912998e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:07.990737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ad793093-2d26-4dfc-a4c2-49dfe912998e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:07.992039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ad793093-2d26-4dfc-a4c2-49dfe912998e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:08.000042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 694/1384] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:08.042870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026c1ef-6e79-41ad-af27-315ab282ecba None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:08.059389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026c1ef-6e79-41ad-af27-315ab282ecba None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:08.065050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d2bf6-f1c4-45e1-a0dc-9cfa87c65e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:08.065704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d2bf6-f1c4-45e1-a0dc-9cfa87c65e50 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:08.065991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d2bf6-f1c4-45e1-a0dc-9cfa87c65e50 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:08.067010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d2bf6-f1c4-45e1-a0dc-9cfa87c65e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:08.076149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d2bf6-f1c4-45e1-a0dc-9cfa87c65e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:08.077757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d2bf6-f1c4-45e1-a0dc-9cfa87c65e50 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:08.087718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 691/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:10.171296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4c078-1948-46b8-9ebd-6269fb2a53d8 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:10.171868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4c078-1948-46b8-9ebd-6269fb2a53d8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:10.171868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4c078-1948-46b8-9ebd-6269fb2a53d8 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:10.173306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 695/1386] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:10.178729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92c92f-84ba-4cd2-adb2-4a0e937d6677 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:10.179174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92c92f-84ba-4cd2-adb2-4a0e937d6677 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:10.179280 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92c92f-84ba-4cd2-adb2-4a0e937d6677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:10.197427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ea92c92f-84ba-4cd2-adb2-4a0e937d6677 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:10.198630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ea92c92f-84ba-4cd2-adb2-4a0e937d6677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:10.206735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 692/1387] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:10.251876 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4c078-1948-46b8-9ebd-6269fb2a53d8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:10.268140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4c078-1948-46b8-9ebd-6269fb2a53d8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:10.274719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff0dc3-246a-4eb3-a8cf-04e4622d0b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:10.276256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff0dc3-246a-4eb3-a8cf-04e4622d0b70 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:10.276256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff0dc3-246a-4eb3-a8cf-04e4622d0b70 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:10.276256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff0dc3-246a-4eb3-a8cf-04e4622d0b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:10.285875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff0dc3-246a-4eb3-a8cf-04e4622d0b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:10.287490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff0dc3-246a-4eb3-a8cf-04e4622d0b70 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:10.297592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 696/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:12.413670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099bd54-e52f-4cdc-afe1-609f6c44efba None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:12.414236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099bd54-e52f-4cdc-afe1-609f6c44efba None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:12.414236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099bd54-e52f-4cdc-afe1-609f6c44efba None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:12.415611 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 693/1389] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:12.422307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f330b-3b9a-4d3d-a82f-aadd99e0dc7b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:12.422776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f330b-3b9a-4d3d-a82f-aadd99e0dc7b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:12.422899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f330b-3b9a-4d3d-a82f-aadd99e0dc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:12.442025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ef4f330b-3b9a-4d3d-a82f-aadd99e0dc7b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:12.443227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ef4f330b-3b9a-4d3d-a82f-aadd99e0dc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:12.451650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 697/1390] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:12.506212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099bd54-e52f-4cdc-afe1-609f6c44efba None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:12.521352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099bd54-e52f-4cdc-afe1-609f6c44efba None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:12.527033 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe960d-5b6d-4c08-8b2b-2047c199f889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:12.527680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe960d-5b6d-4c08-8b2b-2047c199f889 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:12.527969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe960d-5b6d-4c08-8b2b-2047c199f889 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:12.528248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe960d-5b6d-4c08-8b2b-2047c199f889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:12.537545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe960d-5b6d-4c08-8b2b-2047c199f889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:12.539132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe960d-5b6d-4c08-8b2b-2047c199f889 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:12.548915 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 694/1391] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:14.607129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf762-cbcb-4ae6-8cb7-17806ad5c061 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:14.607861 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf762-cbcb-4ae6-8cb7-17806ad5c061 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:14.607861 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf762-cbcb-4ae6-8cb7-17806ad5c061 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:14.609122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 698/1392] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:14.614864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c122-bed6-480e-bc48-46c15ee6632b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:14.615335 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c122-bed6-480e-bc48-46c15ee6632b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:14.615444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c122-bed6-480e-bc48-46c15ee6632b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:14.638015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-baa5c122-bed6-480e-bc48-46c15ee6632b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:14.639286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-baa5c122-bed6-480e-bc48-46c15ee6632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:14.648257 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 695/1393] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:14.694615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdf762-cbcb-4ae6-8cb7-17806ad5c061 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:14.711678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdf762-cbcb-4ae6-8cb7-17806ad5c061 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:14.717330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e5d4f-e249-471a-9124-451ba53d09ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:14.718002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5d4f-e249-471a-9124-451ba53d09ba service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:14.718300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5d4f-e249-471a-9124-451ba53d09ba service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:14.718592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5d4f-e249-471a-9124-451ba53d09ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:14.727483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e5d4f-e249-471a-9124-451ba53d09ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:14.729197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e5d4f-e249-471a-9124-451ba53d09ba service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:14.740032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 699/1394] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:16.866831 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843dcc4-ecc6-4db1-971d-6761b6b403c0 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:16.867409 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843dcc4-ecc6-4db1-971d-6761b6b403c0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:16.867409 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843dcc4-ecc6-4db1-971d-6761b6b403c0 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:16.868808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 696/1395] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:16.874187 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8ea6-6f2f-434a-96c1-9295c510c853 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:16.874631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8ea6-6f2f-434a-96c1-9295c510c853 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:16.874729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8ea6-6f2f-434a-96c1-9295c510c853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:16.894186 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-87ee8ea6-6f2f-434a-96c1-9295c510c853 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:16.896328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-87ee8ea6-6f2f-434a-96c1-9295c510c853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:16.904493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 700/1396] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:16.950239 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843dcc4-ecc6-4db1-971d-6761b6b403c0 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:16.965258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843dcc4-ecc6-4db1-971d-6761b6b403c0 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:16.970666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f2572-b86a-4b58-a874-a057db258deb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:16.971306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f2572-b86a-4b58-a874-a057db258deb service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:16.971590 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f2572-b86a-4b58-a874-a057db258deb service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:16.971869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f2572-b86a-4b58-a874-a057db258deb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:16.980349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f2572-b86a-4b58-a874-a057db258deb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:16.981960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f2572-b86a-4b58-a874-a057db258deb service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:16.991866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 697/1397] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:17.828299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b322eb-d204-4049-97bc-e21bb78b9b41 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:17.828593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b322eb-d204-4049-97bc-e21bb78b9b41 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:17.828942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b322eb-d204-4049-97bc-e21bb78b9b41 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:17.830384 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 701/1398] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:17.835720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1f731-a924-479b-8e62-8717223de8f9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:17.836015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1f731-a924-479b-8e62-8717223de8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:17.836296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1f731-a924-479b-8e62-8717223de8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:17.854207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9de1f731-a924-479b-8e62-8717223de8f9 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:17.855390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9de1f731-a924-479b-8e62-8717223de8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:17.863607 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 698/1399] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:17.921178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9538a8b-1086-4a98-bd75-3cba733ec02c None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:17.921609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9538a8b-1086-4a98-bd75-3cba733ec02c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:17.921757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9538a8b-1086-4a98-bd75-3cba733ec02c None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:17.923143 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 702/1400] 10.222.0.40 () {54 vars in 962 bytes} [Mon Jun 20 06:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:17.928728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ecf4f-f645-4473-b40f-832919f3f0b0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:17.929128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ecf4f-f645-4473-b40f-832919f3f0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:17.929448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ecf4f-f645-4473-b40f-832919f3f0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:17.977770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-064ecf4f-f645-4473-b40f-832919f3f0b0 None None] MFA Rules not processed for user `3780488ee9404b3b8eda52acf8dceca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:17.978950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-064ecf4f-f645-4473-b40f-832919f3f0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:18.038327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 699/1401] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Jun 20 06:06:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:18.046081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9538a8b-1086-4a98-bd75-3cba733ec02c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:18.057594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9538a8b-1086-4a98-bd75-3cba733ec02c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:18.061092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d968f8-a971-49a6-a2a5-d1e78623ed53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3780488ee9404b3b8eda52acf8dceca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:18.061889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d968f8-a971-49a6-a2a5-d1e78623ed53 service glance] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:18.062173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d968f8-a971-49a6-a2a5-d1e78623ed53 service glance] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:18.062448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d968f8-a971-49a6-a2a5-d1e78623ed53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:18.072332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d968f8-a971-49a6-a2a5-d1e78623ed53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:18.073801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d968f8-a971-49a6-a2a5-d1e78623ed53 service glance] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:18.083669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 703/1402] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:18.794662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c51c-75c9-4c40-bb7a-185c36f66984 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:18.794892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c51c-75c9-4c40-bb7a-185c36f66984 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:18.795192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c51c-75c9-4c40-bb7a-185c36f66984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:18.844684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-af00c51c-75c9-4c40-bb7a-185c36f66984 None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:18.845897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-af00c51c-75c9-4c40-bb7a-185c36f66984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:18.889329 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:18.913589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 700/1403] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:06:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:18.954622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fefe32-27cc-4d4c-9406-ba0655045154 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:18.955145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fefe32-27cc-4d4c-9406-ba0655045154 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:18.955335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fefe32-27cc-4d4c-9406-ba0655045154 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:18.957786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 704/1404] 10.222.0.40 () {54 vars in 942 bytes} [Mon Jun 20 06:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:18.964300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc864b5a-4429-4303-ba7d-6ada8fbc9460 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:18.964739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc864b5a-4429-4303-ba7d-6ada8fbc9460 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:18.964906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc864b5a-4429-4303-ba7d-6ada8fbc9460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:19.014570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-bc864b5a-4429-4303-ba7d-6ada8fbc9460 None None] MFA Rules not processed for user `0aadba0174824781b1866da7ba39956e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:19.015784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-bc864b5a-4429-4303-ba7d-6ada8fbc9460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:19.088440 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 701/1405] 10.222.0.40 () {58 vars in 1039 bytes} [Mon Jun 20 06:06:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:19.097837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fefe32-27cc-4d4c-9406-ba0655045154 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:19.102437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712551e-dc2f-4866-9c21-f8ebe0e52865 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:19.102735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712551e-dc2f-4866-9c21-f8ebe0e52865 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:19.103010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712551e-dc2f-4866-9c21-f8ebe0e52865 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:19.104389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 702/1406] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:06:19.105698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=61 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:19.109304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16aba26-e443-4cd1-a517-f978bf4eeec3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:19.109617 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16aba26-e443-4cd1-a517-f978bf4eeec3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:19.109899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16aba26-e443-4cd1-a517-f978bf4eeec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:19.113373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fefe32-27cc-4d4c-9406-ba0655045154 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:19.118807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab7e41-7e80-45a6-a0b1-81ec80d8cd62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:19.119462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab7e41-7e80-45a6-a0b1-81ec80d8cd62 service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:19.119752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab7e41-7e80-45a6-a0b1-81ec80d8cd62 service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:19.120033 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab7e41-7e80-45a6-a0b1-81ec80d8cd62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:19.128078 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b16aba26-e443-4cd1-a517-f978bf4eeec3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:19.129353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab7e41-7e80-45a6-a0b1-81ec80d8cd62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:19.130517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b16aba26-e443-4cd1-a517-f978bf4eeec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:19.131112 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab7e41-7e80-45a6-a0b1-81ec80d8cd62 service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:19.139763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 705/1407] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:06:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:06:19.142341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 703/1408] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:06:19.193744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab7e41-7e80-45a6-a0b1-81ec80d8cd62 service swift] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:19.206085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab7e41-7e80-45a6-a0b1-81ec80d8cd62 service swift] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:19.212895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d4804-a4d1-4f8c-b236-0b8679b1c9a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:19.213552 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4804-a4d1-4f8c-b236-0b8679b1c9a9 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:19.213837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4804-a4d1-4f8c-b236-0b8679b1c9a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:19.214116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4804-a4d1-4f8c-b236-0b8679b1c9a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:19.223384 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d4804-a4d1-4f8c-b236-0b8679b1c9a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:19.225041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d4804-a4d1-4f8c-b236-0b8679b1c9a9 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:19.235586 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 706/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:29.122808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=56 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:29.230750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=11 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:06:42.026965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faf7d9-d89d-4ac2-a611-4e0f465fc0f1 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:42.027529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faf7d9-d89d-4ac2-a611-4e0f465fc0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:42.027529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faf7d9-d89d-4ac2-a611-4e0f465fc0f1 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:42.028875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 704/1410] 10.222.0.40 () {54 vars in 918 bytes} [Mon Jun 20 06:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:42.033886 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c47db-b2df-4fc3-870c-705e3ec35d3a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:42.034288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c47db-b2df-4fc3-870c-705e3ec35d3a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:42.034508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c47db-b2df-4fc3-870c-705e3ec35d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:42.052731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f16c47db-b2df-4fc3-870c-705e3ec35d3a None None] MFA Rules not processed for user `577f89ef22954926bdf02a15484f8f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:42.053896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f16c47db-b2df-4fc3-870c-705e3ec35d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:42.062925 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 707/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Jun 20 06:06:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:06:42.077380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e810-f46e-42d8-9371-a2b3aba3dc27 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:42.077671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e810-f46e-42d8-9371-a2b3aba3dc27 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:42.077948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e810-f46e-42d8-9371-a2b3aba3dc27 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:42.079298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 705/1412] 10.222.0.40 () {54 vars in 918 bytes} [Mon Jun 20 06:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:42.084312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184b7c7-a5a3-45f7-8ae8-e6b18f2e4bca None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:42.084604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184b7c7-a5a3-45f7-8ae8-e6b18f2e4bca None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:42.084911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184b7c7-a5a3-45f7-8ae8-e6b18f2e4bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:42.102634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4184b7c7-a5a3-45f7-8ae8-e6b18f2e4bca None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:42.103809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4184b7c7-a5a3-45f7-8ae8-e6b18f2e4bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:42.113721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 708/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Jun 20 06:06:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:44.607746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f512c7-7f7e-4994-9737-773b061d0566 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:44.608321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f512c7-7f7e-4994-9737-773b061d0566 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:44.608321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f512c7-7f7e-4994-9737-773b061d0566 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:44.609707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:44.615083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e860b9-bdd7-4de2-afdf-949bd7df3666 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:44.615482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e860b9-bdd7-4de2-afdf-949bd7df3666 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:44.615655 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e860b9-bdd7-4de2-afdf-949bd7df3666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:44.633598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-50e860b9-bdd7-4de2-afdf-949bd7df3666 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:44.634798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-50e860b9-bdd7-4de2-afdf-949bd7df3666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:44.642671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:06:44.686636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f512c7-7f7e-4994-9737-773b061d0566 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:44.701105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f512c7-7f7e-4994-9737-773b061d0566 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:44.706920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2aec6-2182-4364-ac64-9b0503d855a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:44.707553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2aec6-2182-4364-ac64-9b0503d855a2 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:44.707836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2aec6-2182-4364-ac64-9b0503d855a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:44.708118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2aec6-2182-4364-ac64-9b0503d855a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:44.716137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2aec6-2182-4364-ac64-9b0503d855a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:44.717812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2aec6-2182-4364-ac64-9b0503d855a2 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:44.727936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 707/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:45.638899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb787-7331-4633-9d04-b16f16c5b3d5 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:45.639423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb787-7331-4633-9d04-b16f16c5b3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:45.639532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb787-7331-4633-9d04-b16f16c5b3d5 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:45.641013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:45.646287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f495-20c0-4cef-8425-4c05ca65d4dd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:45.646754 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f495-20c0-4cef-8425-4c05ca65d4dd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:45.646883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f495-20c0-4cef-8425-4c05ca65d4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:45.665177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7b90f495-20c0-4cef-8425-4c05ca65d4dd None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:45.666615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7b90f495-20c0-4cef-8425-4c05ca65d4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:45.674352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:06:45.828412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cb787-7331-4633-9d04-b16f16c5b3d5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:45.843509 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cb787-7331-4633-9d04-b16f16c5b3d5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:45.850172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354ebac-6d10-40cc-b7b2-089e0a60c7ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:45.850741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354ebac-6d10-40cc-b7b2-089e0a60c7ca service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:45.851023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354ebac-6d10-40cc-b7b2-089e0a60c7ca service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:45.851295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354ebac-6d10-40cc-b7b2-089e0a60c7ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:45.859537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354ebac-6d10-40cc-b7b2-089e0a60c7ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:45.861145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354ebac-6d10-40cc-b7b2-089e0a60c7ca service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:45.870907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 711/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:46.756389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a037c32-4e09-47ef-922d-0f8be701a24f None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:46.756983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a037c32-4e09-47ef-922d-0f8be701a24f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:46.756983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a037c32-4e09-47ef-922d-0f8be701a24f None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:46.758383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:46.763320 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fae7bb-28de-4472-aa96-45f853f7f1be None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:46.763707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fae7bb-28de-4472-aa96-45f853f7f1be None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:46.763891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fae7bb-28de-4472-aa96-45f853f7f1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:46.781881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-41fae7bb-28de-4472-aa96-45f853f7f1be None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:46.783082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-41fae7bb-28de-4472-aa96-45f853f7f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:46.790894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:46.942406 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a037c32-4e09-47ef-922d-0f8be701a24f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:46.956969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a037c32-4e09-47ef-922d-0f8be701a24f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:46.963131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8f0ec-4edb-466e-a4f9-9345ceef90c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:46.963758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8f0ec-4edb-466e-a4f9-9345ceef90c8 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:46.964041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8f0ec-4edb-466e-a4f9-9345ceef90c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:46.964319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8f0ec-4edb-466e-a4f9-9345ceef90c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:46.973351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8f0ec-4edb-466e-a4f9-9345ceef90c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:46.974920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8f0ec-4edb-466e-a4f9-9345ceef90c8 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:46.984138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 710/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:47.843439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a2ac5-de7f-4941-9e43-ed0731ccc818 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:47.843938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a2ac5-de7f-4941-9e43-ed0731ccc818 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:47.844048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a2ac5-de7f-4941-9e43-ed0731ccc818 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:47.845395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:47.851059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f11872-32f3-4dcb-ac3a-dbce8f5fc1c6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:47.851490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f11872-32f3-4dcb-ac3a-dbce8f5fc1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:47.851654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f11872-32f3-4dcb-ac3a-dbce8f5fc1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:47.870153 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-89f11872-32f3-4dcb-ac3a-dbce8f5fc1c6 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:47.871341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-89f11872-32f3-4dcb-ac3a-dbce8f5fc1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:47.879289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:48.029253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a2ac5-de7f-4941-9e43-ed0731ccc818 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:48.044246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a2ac5-de7f-4941-9e43-ed0731ccc818 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:48.050189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626a10f-714f-4b40-ae43-36eb9e2606ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:48.050837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a10f-714f-4b40-ae43-36eb9e2606ce service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:48.051122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a10f-714f-4b40-ae43-36eb9e2606ce service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:48.051404 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a10f-714f-4b40-ae43-36eb9e2606ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:48.059492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626a10f-714f-4b40-ae43-36eb9e2606ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:48.061109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626a10f-714f-4b40-ae43-36eb9e2606ce service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:48.070301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 714/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:48.944552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eddd7-8379-432d-9f26-a7939481a443 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:48.945123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eddd7-8379-432d-9f26-a7939481a443 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:48.945123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eddd7-8379-432d-9f26-a7939481a443 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:48.946430 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:48.951398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe60ecb-4ef5-4358-a952-a2ce528c65ba None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:48.951825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe60ecb-4ef5-4358-a952-a2ce528c65ba None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:48.952062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe60ecb-4ef5-4358-a952-a2ce528c65ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:48.973343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-abe60ecb-4ef5-4358-a952-a2ce528c65ba None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:48.974679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-abe60ecb-4ef5-4358-a952-a2ce528c65ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:48.982459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:06:49.133355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eddd7-8379-432d-9f26-a7939481a443 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:49.148371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eddd7-8379-432d-9f26-a7939481a443 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:49.153821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac579-a665-4fe1-9583-3c6b55612171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:49.154457 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac579-a665-4fe1-9583-3c6b55612171 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:49.154743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac579-a665-4fe1-9583-3c6b55612171 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:49.155055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac579-a665-4fe1-9583-3c6b55612171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:49.163934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ac579-a665-4fe1-9583-3c6b55612171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:49.165548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ac579-a665-4fe1-9583-3c6b55612171 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:49.175436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 713/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:49.989465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e74817-53e0-4e4a-a42f-e6f99cdb1cec None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:49.989999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e74817-53e0-4e4a-a42f-e6f99cdb1cec None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:49.989999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e74817-53e0-4e4a-a42f-e6f99cdb1cec None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:49.991313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:49.996140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88342-4541-4bbb-9a11-61feda5bdb87 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:49.996586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88342-4541-4bbb-9a11-61feda5bdb87 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:49.996754 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88342-4541-4bbb-9a11-61feda5bdb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:50.014975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-11b88342-4541-4bbb-9a11-61feda5bdb87 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:50.016165 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-11b88342-4541-4bbb-9a11-61feda5bdb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:50.024604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:06:50.176539 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e74817-53e0-4e4a-a42f-e6f99cdb1cec None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:50.191198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e74817-53e0-4e4a-a42f-e6f99cdb1cec None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:50.196854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f30c33-4f81-4155-ade9-5a1d3c70347f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:50.197493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30c33-4f81-4155-ade9-5a1d3c70347f service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:50.197775 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30c33-4f81-4155-ade9-5a1d3c70347f service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:50.198058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30c33-4f81-4155-ade9-5a1d3c70347f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:50.206832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f30c33-4f81-4155-ade9-5a1d3c70347f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:50.208349 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f30c33-4f81-4155-ade9-5a1d3c70347f service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:50.217718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 717/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:51.050225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909fd7c-b9e4-47e6-aab0-a1995c416124 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:51.050775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909fd7c-b9e4-47e6-aab0-a1995c416124 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:51.050775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909fd7c-b9e4-47e6-aab0-a1995c416124 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:51.052097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:51.057149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d487ab-20c7-457b-b1a3-739a5172b4ba None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:51.057558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d487ab-20c7-457b-b1a3-739a5172b4ba None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:51.057719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d487ab-20c7-457b-b1a3-739a5172b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:51.076204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-66d487ab-20c7-457b-b1a3-739a5172b4ba None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:51.077464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-66d487ab-20c7-457b-b1a3-739a5172b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:51.086177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:51.235883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909fd7c-b9e4-47e6-aab0-a1995c416124 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:51.250513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909fd7c-b9e4-47e6-aab0-a1995c416124 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:51.256892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f32cbe-e98e-4635-a965-743aff65c5f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:51.257570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32cbe-e98e-4635-a965-743aff65c5f4 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:51.257888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32cbe-e98e-4635-a965-743aff65c5f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:51.258170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f32cbe-e98e-4635-a965-743aff65c5f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:51.266389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f32cbe-e98e-4635-a965-743aff65c5f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:51.267975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f32cbe-e98e-4635-a965-743aff65c5f4 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:51.277610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 716/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:52.092522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610e0cb-4eae-4b81-af4c-00b3fdf32a77 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:52.093182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610e0cb-4eae-4b81-af4c-00b3fdf32a77 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:52.093182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610e0cb-4eae-4b81-af4c-00b3fdf32a77 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:52.094715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:52.099708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af86524-a695-487c-9450-11adaa51854a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:52.100145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af86524-a695-487c-9450-11adaa51854a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:52.100280 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af86524-a695-487c-9450-11adaa51854a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:52.118657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1af86524-a695-487c-9450-11adaa51854a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:52.119874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1af86524-a695-487c-9450-11adaa51854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:52.128579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:52.278459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610e0cb-4eae-4b81-af4c-00b3fdf32a77 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:52.293402 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610e0cb-4eae-4b81-af4c-00b3fdf32a77 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:52.298662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9ec84-0aa9-41e2-851a-e305e4a716ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:52.299867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9ec84-0aa9-41e2-851a-e305e4a716ab service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:52.300242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9ec84-0aa9-41e2-851a-e305e4a716ab service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:52.300534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9ec84-0aa9-41e2-851a-e305e4a716ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:52.308780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9ec84-0aa9-41e2-851a-e305e4a716ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:52.310369 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9ec84-0aa9-41e2-851a-e305e4a716ab service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:52.319603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 720/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:53.137996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9961a-4f7a-45db-b9c6-2c8fcdcc89b3 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:53.138591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9961a-4f7a-45db-b9c6-2c8fcdcc89b3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:53.138591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9961a-4f7a-45db-b9c6-2c8fcdcc89b3 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:53.139925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:53.145533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5deafa-c2cd-4888-9e94-70a3e2a3a9e6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:53.145955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5deafa-c2cd-4888-9e94-70a3e2a3a9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:53.146108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5deafa-c2cd-4888-9e94-70a3e2a3a9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:53.163875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-cb5deafa-c2cd-4888-9e94-70a3e2a3a9e6 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:53.165121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cb5deafa-c2cd-4888-9e94-70a3e2a3a9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:53.173204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:53.327163 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9961a-4f7a-45db-b9c6-2c8fcdcc89b3 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:53.342498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9961a-4f7a-45db-b9c6-2c8fcdcc89b3 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:53.348752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb64c8b-ddad-4c07-a6c7-91a60ffa8758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:53.349392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb64c8b-ddad-4c07-a6c7-91a60ffa8758 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:53.349689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb64c8b-ddad-4c07-a6c7-91a60ffa8758 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:53.349952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb64c8b-ddad-4c07-a6c7-91a60ffa8758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:53.358303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb64c8b-ddad-4c07-a6c7-91a60ffa8758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:53.359872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb64c8b-ddad-4c07-a6c7-91a60ffa8758 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:53.370189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 719/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:55.300328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8286-5144-4e45-b224-df6785e3eeda None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:55.300932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8286-5144-4e45-b224-df6785e3eeda None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:55.300932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8286-5144-4e45-b224-df6785e3eeda None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:55.302320 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:55.307462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78bbc-ebca-40a5-a081-48d6048c7a9a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:55.307869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78bbc-ebca-40a5-a081-48d6048c7a9a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:55.308029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78bbc-ebca-40a5-a081-48d6048c7a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:55.326059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d2f78bbc-ebca-40a5-a081-48d6048c7a9a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:55.327252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d2f78bbc-ebca-40a5-a081-48d6048c7a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:55.335667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:55.374082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e8286-5144-4e45-b224-df6785e3eeda None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:55.386119 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e8286-5144-4e45-b224-df6785e3eeda None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:55.389962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebfd22-60e7-4ec8-a29d-00b65c0818d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:55.390633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebfd22-60e7-4ec8-a29d-00b65c0818d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:55.390917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebfd22-60e7-4ec8-a29d-00b65c0818d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:55.391199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebfd22-60e7-4ec8-a29d-00b65c0818d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:55.401163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebfd22-60e7-4ec8-a29d-00b65c0818d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:55.402602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebfd22-60e7-4ec8-a29d-00b65c0818d2 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:55.411915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 723/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:06:57.661641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6e4d-10c3-4292-81f9-5398cdb5e921 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:57.662150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6e4d-10c3-4292-81f9-5398cdb5e921 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:57.662266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6e4d-10c3-4292-81f9-5398cdb5e921 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:57.663564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:06:57.669069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1785e-1c9d-4071-9384-3c58c6d3fc31 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:57.669513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1785e-1c9d-4071-9384-3c58c6d3fc31 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:57.669637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1785e-1c9d-4071-9384-3c58c6d3fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:57.688136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-12d1785e-1c9d-4071-9384-3c58c6d3fc31 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:06:57.689374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-12d1785e-1c9d-4071-9384-3c58c6d3fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:06:57.697309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:06:57.735847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c6e4d-10c3-4292-81f9-5398cdb5e921 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:06:57.747202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c6e4d-10c3-4292-81f9-5398cdb5e921 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:06:57.751015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ff004-cac5-46d9-958f-65708cc92588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:06:57.751662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff004-cac5-46d9-958f-65708cc92588 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:06:57.751978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff004-cac5-46d9-958f-65708cc92588 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:06:57.752472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff004-cac5-46d9-958f-65708cc92588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:06:57.761421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ff004-cac5-46d9-958f-65708cc92588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:06:57.762840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ff004-cac5-46d9-958f-65708cc92588 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:06:57.772185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 722/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:00.128076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a081c-1248-492f-b208-68bbc75e4ecf None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:00.128669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a081c-1248-492f-b208-68bbc75e4ecf None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:00.128669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a081c-1248-492f-b208-68bbc75e4ecf None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:00.130067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:00.135342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c67067-e663-4579-b414-e5d010a8eae5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:00.135759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c67067-e663-4579-b414-e5d010a8eae5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:00.135908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c67067-e663-4579-b414-e5d010a8eae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:00.153764 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-45c67067-e663-4579-b414-e5d010a8eae5 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:00.154954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-45c67067-e663-4579-b414-e5d010a8eae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:00.163304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:00.201411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a081c-1248-492f-b208-68bbc75e4ecf None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:00.212501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a081c-1248-492f-b208-68bbc75e4ecf None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:00.215973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac1762-c21b-43a4-b861-aa0e748da2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:00.216597 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1762-c21b-43a4-b861-aa0e748da2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:00.216906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1762-c21b-43a4-b861-aa0e748da2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:00.217179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1762-c21b-43a4-b861-aa0e748da2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:00.226563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac1762-c21b-43a4-b861-aa0e748da2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:00.228021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac1762-c21b-43a4-b861-aa0e748da2f5 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:00.237552 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 726/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:02.428326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e75bdc-e602-4d02-85fd-4b071bfb300e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:02.428898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e75bdc-e602-4d02-85fd-4b071bfb300e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:02.429030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e75bdc-e602-4d02-85fd-4b071bfb300e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:02.430338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:02.435496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4e5b-45a8-4cdf-b355-86f75128cac2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:02.435895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4e5b-45a8-4cdf-b355-86f75128cac2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:02.436059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4e5b-45a8-4cdf-b355-86f75128cac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:02.457360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-641d4e5b-45a8-4cdf-b355-86f75128cac2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:02.458614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-641d4e5b-45a8-4cdf-b355-86f75128cac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:02.468433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:02.507523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e75bdc-e602-4d02-85fd-4b071bfb300e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:02.518127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e75bdc-e602-4d02-85fd-4b071bfb300e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:02.521670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8480922-c948-4e11-9b46-1889564677c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:02.522298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480922-c948-4e11-9b46-1889564677c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:02.522582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480922-c948-4e11-9b46-1889564677c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:02.522857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480922-c948-4e11-9b46-1889564677c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:02.531941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8480922-c948-4e11-9b46-1889564677c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:02.533929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8480922-c948-4e11-9b46-1889564677c9 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:02.543296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 725/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:04.661951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b702eb0-a0a9-4506-8c4f-70885214386a None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:04.662505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b702eb0-a0a9-4506-8c4f-70885214386a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:04.662505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b702eb0-a0a9-4506-8c4f-70885214386a None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:04.663874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:04.669272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ed5b2-2c03-477a-82e9-87724e717cfc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:04.669691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ed5b2-2c03-477a-82e9-87724e717cfc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:04.669839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ed5b2-2c03-477a-82e9-87724e717cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:04.687780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2e2ed5b2-2c03-477a-82e9-87724e717cfc None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:04.689653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2e2ed5b2-2c03-477a-82e9-87724e717cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:04.697617 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:04.734899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b702eb0-a0a9-4506-8c4f-70885214386a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:04.746122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b702eb0-a0a9-4506-8c4f-70885214386a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:04.749637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f1a5b-bd00-4759-98f7-56ae3bd29c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:04.750273 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f1a5b-bd00-4759-98f7-56ae3bd29c97 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:04.750555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f1a5b-bd00-4759-98f7-56ae3bd29c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:04.750831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f1a5b-bd00-4759-98f7-56ae3bd29c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:04.760507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f1a5b-bd00-4759-98f7-56ae3bd29c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:04.761963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f1a5b-bd00-4759-98f7-56ae3bd29c97 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:04.771382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 729/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:06.861298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31f7a-f86b-40d7-bccd-8eb44e4999e2 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:06.861986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31f7a-f86b-40d7-bccd-8eb44e4999e2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:06.861986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31f7a-f86b-40d7-bccd-8eb44e4999e2 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:06.863236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:06.868392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abae4f-b117-405e-9fb5-9b365bc6818d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:06.868851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abae4f-b117-405e-9fb5-9b365bc6818d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:06.868993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abae4f-b117-405e-9fb5-9b365bc6818d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:06.887605 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-32abae4f-b117-405e-9fb5-9b365bc6818d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:06.888772 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-32abae4f-b117-405e-9fb5-9b365bc6818d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:06.896867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:06.935566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31f7a-f86b-40d7-bccd-8eb44e4999e2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:06.947496 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31f7a-f86b-40d7-bccd-8eb44e4999e2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:06.951121 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4fb80-d545-40e0-ac07-bd45b0e5402c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:06.951784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fb80-d545-40e0-ac07-bd45b0e5402c service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:06.952068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fb80-d545-40e0-ac07-bd45b0e5402c service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:06.952345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fb80-d545-40e0-ac07-bd45b0e5402c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:06.962312 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4fb80-d545-40e0-ac07-bd45b0e5402c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:06.963749 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4fb80-d545-40e0-ac07-bd45b0e5402c service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:06.973692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 728/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:09.090776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b65b7-b1eb-471b-b7ee-c2f0d8f91f2e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.091314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b65b7-b1eb-471b-b7ee-c2f0d8f91f2e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.091414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b65b7-b1eb-471b-b7ee-c2f0d8f91f2e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.092753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:09.097948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125a4b8-0599-4f15-93cb-8c75c7bf20fd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.098387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125a4b8-0599-4f15-93cb-8c75c7bf20fd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.098512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125a4b8-0599-4f15-93cb-8c75c7bf20fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.117467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5125a4b8-0599-4f15-93cb-8c75c7bf20fd None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.118661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5125a4b8-0599-4f15-93cb-8c75c7bf20fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.127214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.166371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b65b7-b1eb-471b-b7ee-c2f0d8f91f2e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.177458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b65b7-b1eb-471b-b7ee-c2f0d8f91f2e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.180942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431179f-2882-4e48-b0bd-b89705afcea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.181569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431179f-2882-4e48-b0bd-b89705afcea7 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.181854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431179f-2882-4e48-b0bd-b89705afcea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.182132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431179f-2882-4e48-b0bd-b89705afcea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.191593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431179f-2882-4e48-b0bd-b89705afcea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.193068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431179f-2882-4e48-b0bd-b89705afcea7 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.202282 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 732/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:11.271627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3370964-d604-4fcf-89e5-80303cd03e06 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.272169 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3370964-d604-4fcf-89e5-80303cd03e06 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.272169 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3370964-d604-4fcf-89e5-80303cd03e06 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.273593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:11.278763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9145e-c4e5-4da2-9cff-fe82469940ca None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.279162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9145e-c4e5-4da2-9cff-fe82469940ca None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.279323 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9145e-c4e5-4da2-9cff-fe82469940ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.285602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=79 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:11.298488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d6a9145e-c4e5-4da2-9cff-fe82469940ca None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:11.299679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d6a9145e-c4e5-4da2-9cff-fe82469940ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:11.307421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:11.345719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3370964-d604-4fcf-89e5-80303cd03e06 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:11.351075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=73 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:11.357249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3370964-d604-4fcf-89e5-80303cd03e06 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:11.361425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65d830-add8-474f-82e6-23447ef92997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:11.362149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d830-add8-474f-82e6-23447ef92997 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.362435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d830-add8-474f-82e6-23447ef92997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.362713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65d830-add8-474f-82e6-23447ef92997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.371553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65d830-add8-474f-82e6-23447ef92997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:11.373014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65d830-add8-474f-82e6-23447ef92997 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:11.382472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 731/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:13.462865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020318d-1207-4364-a820-24af65f6fca2 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:13.463437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020318d-1207-4364-a820-24af65f6fca2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:13.463437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020318d-1207-4364-a820-24af65f6fca2 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:13.464896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:13.470389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a9ee-9871-41fe-b9d9-cc69b5a6274b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:13.470837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a9ee-9871-41fe-b9d9-cc69b5a6274b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:13.470938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a9ee-9871-41fe-b9d9-cc69b5a6274b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:13.488234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0bf8a9ee-9871-41fe-b9d9-cc69b5a6274b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:13.489455 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0bf8a9ee-9871-41fe-b9d9-cc69b5a6274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:13.497135 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:13.534185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020318d-1207-4364-a820-24af65f6fca2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:13.545116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020318d-1207-4364-a820-24af65f6fca2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:13.549581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284c1d1-a61e-46f9-a712-8b7595c3355e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:13.550418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c1d1-a61e-46f9-a712-8b7595c3355e service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:13.550699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c1d1-a61e-46f9-a712-8b7595c3355e service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:13.550971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c1d1-a61e-46f9-a712-8b7595c3355e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:13.559902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284c1d1-a61e-46f9-a712-8b7595c3355e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:13.561365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284c1d1-a61e-46f9-a712-8b7595c3355e service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:13.571671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 735/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:15.612588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf2fe6-a75e-4a86-9309-bfd9a0dd1766 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:15.613190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf2fe6-a75e-4a86-9309-bfd9a0dd1766 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:15.613190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf2fe6-a75e-4a86-9309-bfd9a0dd1766 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:15.614592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:15.622394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cd4c2-c1d5-4b09-abea-c71de3f7708f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:15.623287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cd4c2-c1d5-4b09-abea-c71de3f7708f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:15.623529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cd4c2-c1d5-4b09-abea-c71de3f7708f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:15.641761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f39cd4c2-c1d5-4b09-abea-c71de3f7708f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:15.642944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f39cd4c2-c1d5-4b09-abea-c71de3f7708f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:15.650846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:15.688198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf2fe6-a75e-4a86-9309-bfd9a0dd1766 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:15.698708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf2fe6-a75e-4a86-9309-bfd9a0dd1766 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:15.702237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcb1e4-87bc-4c50-8d9f-69920659ca28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:15.702869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb1e4-87bc-4c50-8d9f-69920659ca28 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:15.703154 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb1e4-87bc-4c50-8d9f-69920659ca28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:15.703435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb1e4-87bc-4c50-8d9f-69920659ca28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:15.712660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcb1e4-87bc-4c50-8d9f-69920659ca28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:15.714085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcb1e4-87bc-4c50-8d9f-69920659ca28 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:15.723887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 734/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:25.636672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=11 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:25.719285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=14 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:35.757100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21703229-93dd-4515-8e2a-e81fe43e4ab1 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:35.757669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21703229-93dd-4515-8e2a-e81fe43e4ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:35.757669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21703229-93dd-4515-8e2a-e81fe43e4ab1 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:35.759089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 737/1471] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:35.764552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16955c52-927e-463a-91e3-c9e90c38d177 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:35.764959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16955c52-927e-463a-91e3-c9e90c38d177 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:35.765907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16955c52-927e-463a-91e3-c9e90c38d177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:35.784166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-16955c52-927e-463a-91e3-c9e90c38d177 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:35.785387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-16955c52-927e-463a-91e3-c9e90c38d177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:35.793285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 735/1472] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:35.841320 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c618c78-49db-4e4b-9074-577e3c87e8cd None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:35.841616 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c618c78-49db-4e4b-9074-577e3c87e8cd None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:35.841901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c618c78-49db-4e4b-9074-577e3c87e8cd None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:35.843794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 738/1473] 10.222.0.40 () {54 vars in 962 bytes} [Mon Jun 20 06:07:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:35.848842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b359e-1fc9-4eae-9cd1-589f00e3cdbf None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:35.849139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b359e-1fc9-4eae-9cd1-589f00e3cdbf None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:35.849494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b359e-1fc9-4eae-9cd1-589f00e3cdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:35.867881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-868b359e-1fc9-4eae-9cd1-589f00e3cdbf None None] MFA Rules not processed for user `3780488ee9404b3b8eda52acf8dceca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:35.869047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-868b359e-1fc9-4eae-9cd1-589f00e3cdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:35.875903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 736/1474] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Jun 20 06:07:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:35.883045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c618c78-49db-4e4b-9074-577e3c87e8cd None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:35.894516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c618c78-49db-4e4b-9074-577e3c87e8cd None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:35.898136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b27a2-0b7e-4555-9bfb-45824195ec9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3780488ee9404b3b8eda52acf8dceca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:35.898756 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b27a2-0b7e-4555-9bfb-45824195ec9f service glance] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:35.899035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b27a2-0b7e-4555-9bfb-45824195ec9f service glance] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:35.899308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b27a2-0b7e-4555-9bfb-45824195ec9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:35.909316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b27a2-0b7e-4555-9bfb-45824195ec9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:35.910761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b27a2-0b7e-4555-9bfb-45824195ec9f service glance] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:35.920756 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 739/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:07:38.091981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63451-05cb-4894-9723-7eaa6ba14a9f None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:38.092505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63451-05cb-4894-9723-7eaa6ba14a9f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:38.092599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63451-05cb-4894-9723-7eaa6ba14a9f None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:38.094220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 737/1476] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:38.099559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2319f7-c9a7-4691-ab71-0023f173fb7d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:38.099997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2319f7-c9a7-4691-ab71-0023f173fb7d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:38.100307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2319f7-c9a7-4691-ab71-0023f173fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:38.118309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8f2319f7-c9a7-4691-ab71-0023f173fb7d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:38.119508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8f2319f7-c9a7-4691-ab71-0023f173fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:38.128002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 740/1477] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:38.151871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63451-05cb-4894-9723-7eaa6ba14a9f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:38.164451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63451-05cb-4894-9723-7eaa6ba14a9f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:38.168919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23754b63-7649-4053-86f5-13a2fc5a0858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:38.169562 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754b63-7649-4053-86f5-13a2fc5a0858 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:38.169848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754b63-7649-4053-86f5-13a2fc5a0858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:38.170131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754b63-7649-4053-86f5-13a2fc5a0858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:38.170862 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23754b63-7649-4053-86f5-13a2fc5a0858 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:38.172751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: WARNING py.warnings [None req-23754b63-7649-4053-86f5-13a2fc5a0858 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:38.172751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: warnings.warn(msg) Jun 20 06:07:38.172751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: Jun 20 06:07:38.173944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23754b63-7649-4053-86f5-13a2fc5a0858 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:38.194126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 738/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jun 20 06:07:38 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:40.251125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7faca6-f8c3-4d15-aed6-34da5615777b None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:40.251697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7faca6-f8c3-4d15-aed6-34da5615777b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:40.251697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7faca6-f8c3-4d15-aed6-34da5615777b None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:40.253112 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 741/1479] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:07:40.258269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c28c-763f-4f0c-8742-a3a3d020cd51 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:40.258692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c28c-763f-4f0c-8742-a3a3d020cd51 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:40.258908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c28c-763f-4f0c-8742-a3a3d020cd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:40.277112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-94d5c28c-763f-4f0c-8742-a3a3d020cd51 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:40.278321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-94d5c28c-763f-4f0c-8742-a3a3d020cd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:40.286898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 739/1480] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:40.331912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7faca6-f8c3-4d15-aed6-34da5615777b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:40.347140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7faca6-f8c3-4d15-aed6-34da5615777b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:40.352571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1ea1e-8d45-42df-aca7-dec899b82bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:40.353231 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1ea1e-8d45-42df-aca7-dec899b82bbb service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:40.353514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1ea1e-8d45-42df-aca7-dec899b82bbb service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:40.353790 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1ea1e-8d45-42df-aca7-dec899b82bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:40.362559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1ea1e-8d45-42df-aca7-dec899b82bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:40.364172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1ea1e-8d45-42df-aca7-dec899b82bbb service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:40.373604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 742/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:42.579688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51204f0-b07e-49d2-91f3-4679964cf29e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:42.580285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51204f0-b07e-49d2-91f3-4679964cf29e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:42.580285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51204f0-b07e-49d2-91f3-4679964cf29e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:42.581675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 740/1482] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:42.586828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf248d1e-3fd8-4150-b337-61f0110f9e1e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:42.587252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf248d1e-3fd8-4150-b337-61f0110f9e1e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:42.587420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf248d1e-3fd8-4150-b337-61f0110f9e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:42.605969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-cf248d1e-3fd8-4150-b337-61f0110f9e1e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:42.607233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cf248d1e-3fd8-4150-b337-61f0110f9e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:42.615952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 743/1483] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:42.651475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51204f0-b07e-49d2-91f3-4679964cf29e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:42.662737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51204f0-b07e-49d2-91f3-4679964cf29e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:42.666587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335711e-bc7a-46e3-869a-acbf29261004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:42.667220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335711e-bc7a-46e3-869a-acbf29261004 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:42.667508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335711e-bc7a-46e3-869a-acbf29261004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:42.667789 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335711e-bc7a-46e3-869a-acbf29261004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:42.677677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335711e-bc7a-46e3-869a-acbf29261004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:42.679110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335711e-bc7a-46e3-869a-acbf29261004 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:42.688536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 741/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:44.774762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4346ca-f5df-445b-b519-84c843e93b27 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:44.775313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4346ca-f5df-445b-b519-84c843e93b27 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:44.775313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4346ca-f5df-445b-b519-84c843e93b27 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:44.776741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 744/1485] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:44.782974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669298d-cdc8-4b03-a96c-862c98eab6fb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:44.783401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669298d-cdc8-4b03-a96c-862c98eab6fb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:44.783537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669298d-cdc8-4b03-a96c-862c98eab6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:44.802357 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8669298d-cdc8-4b03-a96c-862c98eab6fb None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:44.803557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8669298d-cdc8-4b03-a96c-862c98eab6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:44.811345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 742/1486] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:44.849274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4346ca-f5df-445b-b519-84c843e93b27 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:44.860771 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4346ca-f5df-445b-b519-84c843e93b27 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:44.864522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148435ef-11bb-49ad-bd5e-fee21d92945f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:44.865256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148435ef-11bb-49ad-bd5e-fee21d92945f service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:44.865569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148435ef-11bb-49ad-bd5e-fee21d92945f service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:44.865847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148435ef-11bb-49ad-bd5e-fee21d92945f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:44.874964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148435ef-11bb-49ad-bd5e-fee21d92945f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:44.876386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148435ef-11bb-49ad-bd5e-fee21d92945f service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:44.886087 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 745/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:47.007185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efd5f3-43de-482f-aab0-d1db260ce5f1 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.007723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efd5f3-43de-482f-aab0-d1db260ce5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.007723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efd5f3-43de-482f-aab0-d1db260ce5f1 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.009076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 743/1488] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:47.014335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8212835-c98d-4ec3-ada4-5c44510b7565 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.014759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8212835-c98d-4ec3-ada4-5c44510b7565 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.014948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8212835-c98d-4ec3-ada4-5c44510b7565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.033531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f8212835-c98d-4ec3-ada4-5c44510b7565 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:47.034748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f8212835-c98d-4ec3-ada4-5c44510b7565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:47.043143 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 746/1489] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:47.084492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efd5f3-43de-482f-aab0-d1db260ce5f1 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:47.096054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efd5f3-43de-482f-aab0-d1db260ce5f1 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:47.099629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7df6e-5ba2-467e-bbda-5e3bf1945641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:47.100275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7df6e-5ba2-467e-bbda-5e3bf1945641 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.100555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7df6e-5ba2-467e-bbda-5e3bf1945641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.100860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7df6e-5ba2-467e-bbda-5e3bf1945641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.110820 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7df6e-5ba2-467e-bbda-5e3bf1945641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:47.112260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7df6e-5ba2-467e-bbda-5e3bf1945641 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:47.121553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 744/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:07:49.400538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54a811-3f77-4b79-ace3-4c3e74254666 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.401133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54a811-3f77-4b79-ace3-4c3e74254666 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.401244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54a811-3f77-4b79-ace3-4c3e74254666 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.402645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 747/1491] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jun 20 06:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:49.407964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190e4e-203b-465b-a371-70fef9635ecb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.408374 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190e4e-203b-465b-a371-70fef9635ecb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.408525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190e4e-203b-465b-a371-70fef9635ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.426699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-bf190e4e-203b-465b-a371-70fef9635ecb None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:49.427872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-bf190e4e-203b-465b-a371-70fef9635ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:49.436471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 745/1492] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jun 20 06:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:49.477370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54a811-3f77-4b79-ace3-4c3e74254666 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:49.488110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54a811-3f77-4b79-ace3-4c3e74254666 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:49.491563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa83c5-299e-4e06-9921-4ced1f9b64e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:49.492191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa83c5-299e-4e06-9921-4ced1f9b64e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.492475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa83c5-299e-4e06-9921-4ced1f9b64e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.492886 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa83c5-299e-4e06-9921-4ced1f9b64e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.502397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa83c5-299e-4e06-9921-4ced1f9b64e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:49.503857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa83c5-299e-4e06-9921-4ced1f9b64e9 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:49.513062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 748/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:59.421750 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=33 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:59.508999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=33 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:14.504699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658ce04-f8a0-40bd-9388-ce81fc9ae588 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:14.505301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658ce04-f8a0-40bd-9388-ce81fc9ae588 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:14.505301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658ce04-f8a0-40bd-9388-ce81fc9ae588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:14.523392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4658ce04-f8a0-40bd-9388-ce81fc9ae588 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:14.524563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4658ce04-f8a0-40bd-9388-ce81fc9ae588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:14.532303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 746/1494] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:14.542553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0dc3c-a8a4-4bc0-bb47-6663d5303691 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:14.543060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0dc3c-a8a4-4bc0-bb47-6663d5303691 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:14.543156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0dc3c-a8a4-4bc0-bb47-6663d5303691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:14.561430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f6d0dc3c-a8a4-4bc0-bb47-6663d5303691 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:14.562615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f6d0dc3c-a8a4-4bc0-bb47-6663d5303691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:14.570327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 749/1495] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:14.575152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658ce04-f8a0-40bd-9388-ce81fc9ae588 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:14.584742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658ce04-f8a0-40bd-9388-ce81fc9ae588 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:14.590920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1a2e3-ca68-40d0-98b9-3adbcdf7215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:14.591589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1a2e3-ca68-40d0-98b9-3adbcdf7215f admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:14.591874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1a2e3-ca68-40d0-98b9-3adbcdf7215f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:14.592157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1a2e3-ca68-40d0-98b9-3adbcdf7215f admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:14.592929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1a2e3-ca68-40d0-98b9-3adbcdf7215f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:09:14.593356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1a2e3-ca68-40d0-98b9-3adbcdf7215f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:14.594376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: WARNING py.warnings [None req-cce1a2e3-ca68-40d0-98b9-3adbcdf7215f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:14.594376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: warnings.warn(msg) Jun 20 06:09:14.594376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: Jun 20 06:09:14.595261 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1a2e3-ca68-40d0-98b9-3adbcdf7215f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:14.607212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 747/1496] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:14.615188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0dc3c-a8a4-4bc0-bb47-6663d5303691 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:14.625230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0dc3c-a8a4-4bc0-bb47-6663d5303691 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:14.629897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84586-4078-4e16-b662-399964e304dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:14.630555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84586-4078-4e16-b662-399964e304dd admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:14.630841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84586-4078-4e16-b662-399964e304dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:14.631118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84586-4078-4e16-b662-399964e304dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:14.631807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee84586-4078-4e16-b662-399964e304dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:14.633609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: WARNING py.warnings [None req-5ee84586-4078-4e16-b662-399964e304dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:14.633609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:09:14.633609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: Jun 20 06:09:14.634849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee84586-4078-4e16-b662-399964e304dd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:14.671453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 750/1497] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:14 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:09:14.675630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1a2e3-ca68-40d0-98b9-3adbcdf7215f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:14.686062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1a2e3-ca68-40d0-98b9-3adbcdf7215f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:14.741526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b30ba-842c-472e-b75b-c4f123c92865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:14.742196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b30ba-842c-472e-b75b-c4f123c92865 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:14.742484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b30ba-842c-472e-b75b-c4f123c92865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:14.742766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b30ba-842c-472e-b75b-c4f123c92865 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:14.744002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b30ba-842c-472e-b75b-c4f123c92865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:14.745031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: WARNING py.warnings [None req-dd0b30ba-842c-472e-b75b-c4f123c92865 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:14.745031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: warnings.warn(msg) Jun 20 06:09:14.745031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: Jun 20 06:09:14.746248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b30ba-842c-472e-b75b-c4f123c92865 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:14.766655 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 748/1498] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:14 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:14.770628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84586-4078-4e16-b662-399964e304dd admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:14.780694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84586-4078-4e16-b662-399964e304dd admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:14.785395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074a459-347e-4d44-99a0-ddba34713b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:14.786048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074a459-347e-4d44-99a0-ddba34713b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:14.786600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074a459-347e-4d44-99a0-ddba34713b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:14.786871 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074a459-347e-4d44-99a0-ddba34713b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:14.787603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074a459-347e-4d44-99a0-ddba34713b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:14.788636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: WARNING py.warnings [None req-9074a459-347e-4d44-99a0-ddba34713b0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:14.788636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:09:14.788636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: Jun 20 06:09:14.789516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074a459-347e-4d44-99a0-ddba34713b0d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:14.802656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 751/1499] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:14.806979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b30ba-842c-472e-b75b-c4f123c92865 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:14.816743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b30ba-842c-472e-b75b-c4f123c92865 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:14.821289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e270d7-8481-41dc-a6ce-6c0c72446bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:14.822705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e270d7-8481-41dc-a6ce-6c0c72446bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:14.822989 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e270d7-8481-41dc-a6ce-6c0c72446bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:14.823268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e270d7-8481-41dc-a6ce-6c0c72446bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:14.823990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e270d7-8481-41dc-a6ce-6c0c72446bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:14.825027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: WARNING py.warnings [None req-88e270d7-8481-41dc-a6ce-6c0c72446bd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:14.825027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: warnings.warn(msg) Jun 20 06:09:14.825027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: Jun 20 06:09:14.825918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e270d7-8481-41dc-a6ce-6c0c72446bd6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:14.838928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 749/1500] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:14.843151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074a459-347e-4d44-99a0-ddba34713b0d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:14.853264 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074a459-347e-4d44-99a0-ddba34713b0d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:14.857745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c505b-e49a-4f8c-ba87-80d3d602bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:14.858630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c505b-e49a-4f8c-ba87-80d3d602bd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:14.858909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c505b-e49a-4f8c-ba87-80d3d602bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:14.859183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c505b-e49a-4f8c-ba87-80d3d602bd31 admin admin] PATH_INFO: `/v3/projects/781ca03b97ef4fb8a379671a5d6e4491/users/e76c9db88bdb444ea579059d3f1d57e6/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:14.874277 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c505b-e49a-4f8c-ba87-80d3d602bd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781ca03b97ef4fb8a379671a5d6e4491, user_id=e76c9db88bdb444ea579059d3f1d57e6, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:14.875310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: WARNING py.warnings [None req-c07c505b-e49a-4f8c-ba87-80d3d602bd31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:14.875310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:09:14.875310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: Jun 20 06:09:14.877272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c505b-e49a-4f8c-ba87-80d3d602bd31 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:14.890796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 752/1501] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:14 2022] PUT /identity/v3/projects/781ca03b97ef4fb8a379671a5d6e4491/users/e76c9db88bdb444ea579059d3f1d57e6/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:09:14.902987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a6122-aa84-4e77-aaac-b31b2bc68f54 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:14.903289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a6122-aa84-4e77-aaac-b31b2bc68f54 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:14.903602 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a6122-aa84-4e77-aaac-b31b2bc68f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:14.929557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9e8a6122-aa84-4e77-aaac-b31b2bc68f54 None None] MFA Rules not processed for user `e76c9db88bdb444ea579059d3f1d57e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:14.930761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9e8a6122-aa84-4e77-aaac-b31b2bc68f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:14.997378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 750/1502] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:09:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:15.011472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f825c8-de28-42c4-ab88-b7797f53524e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.011764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f825c8-de28-42c4-ab88-b7797f53524e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.012041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f825c8-de28-42c4-ab88-b7797f53524e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.013449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 753/1503] 10.222.0.40 () {54 vars in 963 bytes} [Mon Jun 20 06:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:15.018165 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2b52-e515-48dd-b9be-143a74785426 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.018404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2b52-e515-48dd-b9be-143a74785426 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.018688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2b52-e515-48dd-b9be-143a74785426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.037082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e86a2b52-e515-48dd-b9be-143a74785426 None None] MFA Rules not processed for user `7071b87350864e478e848e7d3d66e33e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:15.038310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e86a2b52-e515-48dd-b9be-143a74785426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:15.082672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:15.091613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 751/1504] 10.222.0.40 () {58 vars in 1060 bytes} [Mon Jun 20 06:09:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:09:15.100322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f825c8-de28-42c4-ab88-b7797f53524e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:15.111389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f825c8-de28-42c4-ab88-b7797f53524e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:15.114877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51966790-87e6-4ca9-ac69-b478e0f1a73b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:15.115513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51966790-87e6-4ca9-ac69-b478e0f1a73b service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.115783 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51966790-87e6-4ca9-ac69-b478e0f1a73b service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.116058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51966790-87e6-4ca9-ac69-b478e0f1a73b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.124741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51966790-87e6-4ca9-ac69-b478e0f1a73b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:15.126183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51966790-87e6-4ca9-ac69-b478e0f1a73b service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:15.135198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 754/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:15.176948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff10ae4-b10f-425e-bfb6-50d4e028975f None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.177248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff10ae4-b10f-425e-bfb6-50d4e028975f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.177537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff10ae4-b10f-425e-bfb6-50d4e028975f None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.178884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 752/1506] 10.222.0.40 () {52 vars in 829 bytes} [Mon Jun 20 06:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:09:15.183054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51966790-87e6-4ca9-ac69-b478e0f1a73b service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:15.244966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51966790-87e6-4ca9-ac69-b478e0f1a73b service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:15.249623 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:15.250496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.250803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.251111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] PATH_INFO: `/v3/users/e76c9db88bdb444ea579059d3f1d57e6` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.252344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76c9db88bdb444ea579059d3f1d57e6)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:15.253450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: WARNING py.warnings [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:15.253450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:09:15.253450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: Jun 20 06:09:15.254732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:15.322912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76c9db88bdb444ea579059d3f1d57e6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:15.335271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76c9db88bdb444ea579059d3f1d57e6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:15.336049 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76c9db88bdb444ea579059d3f1d57e6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:15.336709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76c9db88bdb444ea579059d3f1d57e6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:15.356176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76c9db88bdb444ea579059d3f1d57e6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:15.360138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:15.374281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 755/1507] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:15 2022] DELETE /identity/v3/users/e76c9db88bdb444ea579059d3f1d57e6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:15.378801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131228-d1fc-42d3-8456-4bdf373ba836 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.379108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131228-d1fc-42d3-8456-4bdf373ba836 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.379417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131228-d1fc-42d3-8456-4bdf373ba836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.396805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-41131228-d1fc-42d3-8456-4bdf373ba836 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:15.398013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-41131228-d1fc-42d3-8456-4bdf373ba836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:15.458379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 753/1508] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:15.468884 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:15.470282 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:15.528068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb99dc-a2a2-46d5-85ea-dcbe607e142b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:15.531688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3a8d6-8619-4d5f-9625-24e1b2f4502e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:15.532344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a8d6-8619-4d5f-9625-24e1b2f4502e service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.532693 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a8d6-8619-4d5f-9625-24e1b2f4502e service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.532947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a8d6-8619-4d5f-9625-24e1b2f4502e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.543199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3a8d6-8619-4d5f-9625-24e1b2f4502e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:15.544777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3a8d6-8619-4d5f-9625-24e1b2f4502e service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:15.554237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 756/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:15.899354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131228-d1fc-42d3-8456-4bdf373ba836 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:15.900951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-41131228-d1fc-42d3-8456-4bdf373ba836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:15.913190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131228-d1fc-42d3-8456-4bdf373ba836 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:15.918549 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:15.919410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.919692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.919967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] PATH_INFO: `/v3/projects/781ca03b97ef4fb8a379671a5d6e4491` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.921363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=781ca03b97ef4fb8a379671a5d6e4491)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:15.922386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: WARNING py.warnings [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:15.922386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: warnings.warn(msg) Jun 20 06:09:15.922386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: Jun 20 06:09:15.923603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:15.984165 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781ca03b97ef4fb8a379671a5d6e4491', 'request_id': 'req-6b62c55d-cc0b-482a-9fed-6cdc486af5af'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:15.998674 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781ca03b97ef4fb8a379671a5d6e4491', 'request_id': 'req-6b62c55d-cc0b-482a-9fed-6cdc486af5af'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:16.005057 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781ca03b97ef4fb8a379671a5d6e4491', 'request_id': 'req-6b62c55d-cc0b-482a-9fed-6cdc486af5af'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:16.020000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] The token cache is being invalidate because project 781ca03b97ef4fb8a379671a5d6e4491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:16.020288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:16.021041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6b62c55d-cc0b-482a-9fed-6cdc486af5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:16.022617 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 754/1510] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:15 2022] DELETE /identity/v3/projects/781ca03b97ef4fb8a379671a5d6e4491 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:25.550069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:26.016922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:03.851995 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472bb3-e5a4-4fe8-b41b-cd050989b3b3 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.852555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472bb3-e5a4-4fe8-b41b-cd050989b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.852687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472bb3-e5a4-4fe8-b41b-cd050989b3b3 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.854037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:03.858773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800aae7-85f4-4c05-a9c6-2eb2a3a6e185 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:03.859205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800aae7-85f4-4c05-a9c6-2eb2a3a6e185 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:03.859344 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800aae7-85f4-4c05-a9c6-2eb2a3a6e185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:03.877201 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9800aae7-85f4-4c05-a9c6-2eb2a3a6e185 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:03.878421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9800aae7-85f4-4c05-a9c6-2eb2a3a6e185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:03.937138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:04.091117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a472bb3-e5a4-4fe8-b41b-cd050989b3b3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:04.092840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8a472bb3-e5a4-4fe8-b41b-cd050989b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:04.166651 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a472bb3-e5a4-4fe8-b41b-cd050989b3b3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:04.172054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87048e2-50a9-423b-b6ae-431cbedcba90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:04.172885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87048e2-50a9-423b-b6ae-431cbedcba90 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:04.173175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87048e2-50a9-423b-b6ae-431cbedcba90 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:04.173460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87048e2-50a9-423b-b6ae-431cbedcba90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:04.182357 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87048e2-50a9-423b-b6ae-431cbedcba90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:04.183972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87048e2-50a9-423b-b6ae-431cbedcba90 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:04.193303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 758/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:05.024709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0852-c5f0-4cfe-8701-053090a78711 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.025249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0852-c5f0-4cfe-8701-053090a78711 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.025249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0852-c5f0-4cfe-8701-053090a78711 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.026569 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:05.031563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d5af-f7ce-4f7e-97c5-4f6dc8872e32 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.031987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d5af-f7ce-4f7e-97c5-4f6dc8872e32 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.032123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d5af-f7ce-4f7e-97c5-4f6dc8872e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.055587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f2b7d5af-f7ce-4f7e-97c5-4f6dc8872e32 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:05.056836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f2b7d5af-f7ce-4f7e-97c5-4f6dc8872e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:05.064540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:05.217230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac0852-c5f0-4cfe-8701-053090a78711 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:05.232385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac0852-c5f0-4cfe-8701-053090a78711 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:05.237746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec39e9-0085-4ef4-9d34-548a3f1c915f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:05.238375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec39e9-0085-4ef4-9d34-548a3f1c915f service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.238659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec39e9-0085-4ef4-9d34-548a3f1c915f service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.238936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec39e9-0085-4ef4-9d34-548a3f1c915f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.247146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec39e9-0085-4ef4-9d34-548a3f1c915f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:05.248772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec39e9-0085-4ef4-9d34-548a3f1c915f service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:05.258456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 757/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:05.464519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad13b9b-1ded-473b-a4cf-6e49939ea7a3 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.464840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad13b9b-1ded-473b-a4cf-6e49939ea7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.465122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad13b9b-1ded-473b-a4cf-6e49939ea7a3 None None] PATH_INFO: `/v3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.466456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 760/1517] 10.222.0.33 () {54 vars in 925 bytes} [Mon Jun 20 06:11:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:11:05.472864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa6e16-1c53-4628-b82e-08ac0883c8c6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:05.473190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa6e16-1c53-4628-b82e-08ac0883c8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:05.473480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa6e16-1c53-4628-b82e-08ac0883c8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:05.491249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d4aa6e16-1c53-4628-b82e-08ac0883c8c6 None None] MFA Rules not processed for user `577f89ef22954926bdf02a15484f8f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:05.492454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d4aa6e16-1c53-4628-b82e-08ac0883c8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:05.553863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 758/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Mon Jun 20 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:14.520396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc1a44-5fc9-4ddf-9c4c-3e06dd1fe169 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:14.520974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc1a44-5fc9-4ddf-9c4c-3e06dd1fe169 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:14.520974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc1a44-5fc9-4ddf-9c4c-3e06dd1fe169 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:14.522274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 761/1519] 10.222.0.40 () {54 vars in 960 bytes} [Mon Jun 20 06:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:14.527790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d814-ee74-4110-a6cc-ea613e6251bb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:14.528221 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d814-ee74-4110-a6cc-ea613e6251bb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:14.528339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d814-ee74-4110-a6cc-ea613e6251bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:14.548150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-cf21d814-ee74-4110-a6cc-ea613e6251bb None None] MFA Rules not processed for user `577f89ef22954926bdf02a15484f8f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:14.549384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cf21d814-ee74-4110-a6cc-ea613e6251bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:14.557936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 759/1520] 10.222.0.40 () {58 vars in 1057 bytes} [Mon Jun 20 06:11:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:14.565429 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc1a44-5fc9-4ddf-9c4c-3e06dd1fe169 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:14.579448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc1a44-5fc9-4ddf-9c4c-3e06dd1fe169 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:14.584241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bb34c-a580-49ab-87c9-7a6b7bab424e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:14.584890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bb34c-a580-49ab-87c9-7a6b7bab424e service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:14.585178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bb34c-a580-49ab-87c9-7a6b7bab424e service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:14.585452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bb34c-a580-49ab-87c9-7a6b7bab424e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:14.594420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bb34c-a580-49ab-87c9-7a6b7bab424e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:14.596049 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bb34c-a580-49ab-87c9-7a6b7bab424e service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:14.605929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 762/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:11:16.501660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982bf58-6366-403f-8668-1fb61971bb91 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:16.502254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982bf58-6366-403f-8668-1fb61971bb91 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:16.502254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982bf58-6366-403f-8668-1fb61971bb91 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:16.503926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:16.509336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58763e12-43ca-4768-912c-05bd9e5a5c8e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:16.509800 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58763e12-43ca-4768-912c-05bd9e5a5c8e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:16.509904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58763e12-43ca-4768-912c-05bd9e5a5c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:16.528732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-58763e12-43ca-4768-912c-05bd9e5a5c8e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:16.529916 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-58763e12-43ca-4768-912c-05bd9e5a5c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:16.537851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:16.697403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982bf58-6366-403f-8668-1fb61971bb91 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:16.712517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982bf58-6366-403f-8668-1fb61971bb91 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:16.717970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3fb83-dc47-4477-8b15-9112b549965a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:16.718621 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3fb83-dc47-4477-8b15-9112b549965a service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:16.718902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3fb83-dc47-4477-8b15-9112b549965a service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:16.719178 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3fb83-dc47-4477-8b15-9112b549965a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:16.727201 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3fb83-dc47-4477-8b15-9112b549965a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:16.728818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3fb83-dc47-4477-8b15-9112b549965a service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:16.738110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 761/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:17.555919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507c43c-d2c5-4b19-b615-c0b9f2c6aceb None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:17.556494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507c43c-d2c5-4b19-b615-c0b9f2c6aceb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:17.556494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507c43c-d2c5-4b19-b615-c0b9f2c6aceb None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:17.557962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:17.562667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5010806-5d1f-4d45-bcbe-0064e9c283b3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:17.563101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5010806-5d1f-4d45-bcbe-0064e9c283b3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:17.563222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5010806-5d1f-4d45-bcbe-0064e9c283b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:17.581389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d5010806-5d1f-4d45-bcbe-0064e9c283b3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:17.582591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d5010806-5d1f-4d45-bcbe-0064e9c283b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:17.591612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:17.753214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507c43c-d2c5-4b19-b615-c0b9f2c6aceb None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:17.768551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507c43c-d2c5-4b19-b615-c0b9f2c6aceb None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:17.773983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5871-00c6-447a-88a6-9f3c4b7dbb3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:17.774952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5871-00c6-447a-88a6-9f3c4b7dbb3e service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:17.775230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5871-00c6-447a-88a6-9f3c4b7dbb3e service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:17.775502 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5871-00c6-447a-88a6-9f3c4b7dbb3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:17.783423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae5871-00c6-447a-88a6-9f3c4b7dbb3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:17.785295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae5871-00c6-447a-88a6-9f3c4b7dbb3e service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:17.795000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 765/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:21.861722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6012-898b-458e-af2f-65f9d35907ad None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:21.862343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6012-898b-458e-af2f-65f9d35907ad None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:21.862343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6012-898b-458e-af2f-65f9d35907ad None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:21.863644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:21.869743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927bc7-ad2a-43da-b163-c7a3ec54e2fd None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:21.870203 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927bc7-ad2a-43da-b163-c7a3ec54e2fd None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:21.870317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927bc7-ad2a-43da-b163-c7a3ec54e2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:21.888886 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c0927bc7-ad2a-43da-b163-c7a3ec54e2fd None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:21.890007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c0927bc7-ad2a-43da-b163-c7a3ec54e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:21.897941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:11:21.935685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f6012-898b-458e-af2f-65f9d35907ad None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:21.937393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-eb4f6012-898b-458e-af2f-65f9d35907ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:21.995476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f6012-898b-458e-af2f-65f9d35907ad None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:21.999034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21355231-3188-4fd8-be75-5619e25cc62a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:21.999675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21355231-3188-4fd8-be75-5619e25cc62a service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:21.999964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21355231-3188-4fd8-be75-5619e25cc62a service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:22.000242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21355231-3188-4fd8-be75-5619e25cc62a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:22.009655 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21355231-3188-4fd8-be75-5619e25cc62a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:22.011085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21355231-3188-4fd8-be75-5619e25cc62a service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:22.015961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:22.021123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 764/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:24.046364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deda28-ea09-4ea0-8562-9163b348312d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.046899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deda28-ea09-4ea0-8562-9163b348312d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.046899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deda28-ea09-4ea0-8562-9163b348312d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.048318 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:11:24.053402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2cf7e-07c7-4d0f-a657-2473c728cc11 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.053852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2cf7e-07c7-4d0f-a657-2473c728cc11 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.054005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2cf7e-07c7-4d0f-a657-2473c728cc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.072829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-99c2cf7e-07c7-4d0f-a657-2473c728cc11 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:24.074026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-99c2cf7e-07c7-4d0f-a657-2473c728cc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:24.081794 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:24.118365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deda28-ea09-4ea0-8562-9163b348312d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:24.129165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deda28-ea09-4ea0-8562-9163b348312d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:24.132652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a1364-e6e2-4019-9c27-2800e1cf9d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:24.133330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1364-e6e2-4019-9c27-2800e1cf9d06 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:24.133611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1364-e6e2-4019-9c27-2800e1cf9d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:24.133889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a1364-e6e2-4019-9c27-2800e1cf9d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:24.142758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a1364-e6e2-4019-9c27-2800e1cf9d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:24.144192 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a1364-e6e2-4019-9c27-2800e1cf9d06 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:24.153525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 768/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:27.785908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3de33-8122-4f20-9223-16cde323cbe8 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:27.786487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3de33-8122-4f20-9223-16cde323cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:27.786487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3de33-8122-4f20-9223-16cde323cbe8 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:27.787847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:27.793255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7108-c74d-4314-9704-da6f2037aed5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:27.793708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7108-c74d-4314-9704-da6f2037aed5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:27.793803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7108-c74d-4314-9704-da6f2037aed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:27.800156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=62 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:27.812939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a6eb7108-c74d-4314-9704-da6f2037aed5 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:27.814148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a6eb7108-c74d-4314-9704-da6f2037aed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:27.822966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:28.133787 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3de33-8122-4f20-9223-16cde323cbe8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:28.136094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-10c3de33-8122-4f20-9223-16cde323cbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.193787 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3de33-8122-4f20-9223-16cde323cbe8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:28.198085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6127a7-cacb-4d89-9e0a-0d010c51f805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:28.198731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6127a7-cacb-4d89-9e0a-0d010c51f805 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:28.199021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6127a7-cacb-4d89-9e0a-0d010c51f805 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:28.199304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6127a7-cacb-4d89-9e0a-0d010c51f805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:28.208470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6127a7-cacb-4d89-9e0a-0d010c51f805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:28.209870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6127a7-cacb-4d89-9e0a-0d010c51f805 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:28.219297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 767/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:30.289880 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47543ce-7377-4b78-a254-5948137c2f6d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.290386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47543ce-7377-4b78-a254-5948137c2f6d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.290496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47543ce-7377-4b78-a254-5948137c2f6d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.291805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:11:30.296958 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f514f-53a3-40e6-b9e6-13b53151cb3d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.297396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f514f-53a3-40e6-b9e6-13b53151cb3d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.297540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f514f-53a3-40e6-b9e6-13b53151cb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.315525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-684f514f-53a3-40e6-b9e6-13b53151cb3d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:30.317018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-684f514f-53a3-40e6-b9e6-13b53151cb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:30.325413 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:30.627800 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47543ce-7377-4b78-a254-5948137c2f6d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:11:30.629504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d47543ce-7377-4b78-a254-5948137c2f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:30.642858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47543ce-7377-4b78-a254-5948137c2f6d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:11:30.646396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9fdfd-52de-4219-a7c9-9bf042f844a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:11:30.647027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9fdfd-52de-4219-a7c9-9bf042f844a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:30.647309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9fdfd-52de-4219-a7c9-9bf042f844a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:30.647585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9fdfd-52de-4219-a7c9-9bf042f844a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:30.656406 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9fdfd-52de-4219-a7c9-9bf042f844a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:11:30.657870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9fdfd-52de-4219-a7c9-9bf042f844a3 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:11:30.667462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 771/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:40.310268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=32 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:40.663227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=8 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:09.418233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d102-5b6b-4e73-b7bd-f901b234848f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.418883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d102-5b6b-4e73-b7bd-f901b234848f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.418883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4d102-5b6b-4e73-b7bd-f901b234848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.445396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-22b4d102-5b6b-4e73-b7bd-f901b234848f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.446624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-22b4d102-5b6b-4e73-b7bd-f901b234848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.452592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0816-a823-4880-9f53-b1aa497212a2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.453193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0816-a823-4880-9f53-b1aa497212a2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.453193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0816-a823-4880-9f53-b1aa497212a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.480291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 769/1540] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.481657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44095ceb-fee4-4695-8e34-32170e9e3ce6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.481954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44095ceb-fee4-4695-8e34-32170e9e3ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.482230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44095ceb-fee4-4695-8e34-32170e9e3ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.492053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7e3f0816-a823-4880-9f53-b1aa497212a2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.493323 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7e3f0816-a823-4880-9f53-b1aa497212a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.515209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 772/1541] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:09.516519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919c9e-542a-4270-a81e-40207fbe9f7a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.516843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919c9e-542a-4270-a81e-40207fbe9f7a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.517127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919c9e-542a-4270-a81e-40207fbe9f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.526664 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-44095ceb-fee4-4695-8e34-32170e9e3ce6 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.527892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-44095ceb-fee4-4695-8e34-32170e9e3ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.547646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 770/1542] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.548985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af14a-b41a-4cb9-9567-f41ceea202d3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.549282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af14a-b41a-4cb9-9567-f41ceea202d3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.549565 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af14a-b41a-4cb9-9567-f41ceea202d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.555951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2f919c9e-542a-4270-a81e-40207fbe9f7a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.557209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2f919c9e-542a-4270-a81e-40207fbe9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.567428 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 773/1543] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.569032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791f1c7-a10b-4980-afd3-4b97e83c12e4 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.570131 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791f1c7-a10b-4980-afd3-4b97e83c12e4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.570415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791f1c7-a10b-4980-afd3-4b97e83c12e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.581118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-382af14a-b41a-4cb9-9567-f41ceea202d3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.582435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-382af14a-b41a-4cb9-9567-f41ceea202d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.591102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f791f1c7-a10b-4980-afd3-4b97e83c12e4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.591376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 771/1544] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.592464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f791f1c7-a10b-4980-afd3-4b97e83c12e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.592842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464046-6b5d-4760-b466-81f34f6d810c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.593304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464046-6b5d-4760-b466-81f34f6d810c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.593747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464046-6b5d-4760-b466-81f34f6d810c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.601084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 774/1545] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.602464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad9cb-cbff-4b4e-883b-90b484a71ae1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.602763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad9cb-cbff-4b4e-883b-90b484a71ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.603076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ad9cb-cbff-4b4e-883b-90b484a71ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.615777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4d464046-6b5d-4760-b466-81f34f6d810c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.618079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4d464046-6b5d-4760-b466-81f34f6d810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.623694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b28ad9cb-cbff-4b4e-883b-90b484a71ae1 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.624987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b28ad9cb-cbff-4b4e-883b-90b484a71ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.628446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 772/1546] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.629200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b472-1f1c-4398-8441-5c0b60d4a1d0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.629857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b472-1f1c-4398-8441-5c0b60d4a1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.629857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b472-1f1c-4398-8441-5c0b60d4a1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.636046 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 775/1547] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.637423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d779958-1e32-4b24-8a79-f8102dcbbafe None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.637731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d779958-1e32-4b24-8a79-f8102dcbbafe None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.638016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d779958-1e32-4b24-8a79-f8102dcbbafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.649016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e4c3b472-1f1c-4398-8441-5c0b60d4a1d0 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.650251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e4c3b472-1f1c-4398-8441-5c0b60d4a1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.656399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8d779958-1e32-4b24-8a79-f8102dcbbafe None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.657609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8d779958-1e32-4b24-8a79-f8102dcbbafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.658229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 773/1548] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.659474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537e2d2-b124-44ff-baa1-42128f38a70b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.659720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537e2d2-b124-44ff-baa1-42128f38a70b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.660272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537e2d2-b124-44ff-baa1-42128f38a70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.667277 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 776/1549] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.668691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10c10d-8931-464a-b673-03135dffab02 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.668931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10c10d-8931-464a-b673-03135dffab02 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.669230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10c10d-8931-464a-b673-03135dffab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.680501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3537e2d2-b124-44ff-baa1-42128f38a70b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.681788 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3537e2d2-b124-44ff-baa1-42128f38a70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.688886 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1e10c10d-8931-464a-b673-03135dffab02 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.689684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 774/1550] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.690138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1e10c10d-8931-464a-b673-03135dffab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.690254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537e2d2-b124-44ff-baa1-42128f38a70b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.701638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537e2d2-b124-44ff-baa1-42128f38a70b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.704134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 777/1551] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.705047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10c10d-8931-464a-b673-03135dffab02 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.709466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8679cae-5986-42c2-bba7-9660d8ffeb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.710518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8679cae-5986-42c2-bba7-9660d8ffeb57 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.710727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8679cae-5986-42c2-bba7-9660d8ffeb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.710890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8679cae-5986-42c2-bba7-9660d8ffeb57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.711628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8679cae-5986-42c2-bba7-9660d8ffeb57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:09.711941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8679cae-5986-42c2-bba7-9660d8ffeb57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.713704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8679cae-5986-42c2-bba7-9660d8ffeb57 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.714896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10c10d-8931-464a-b673-03135dffab02 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.719383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dbbab-7733-4d7b-b385-bd5adb8a56c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.720024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dbbab-7733-4d7b-b385-bd5adb8a56c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.720309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dbbab-7733-4d7b-b385-bd5adb8a56c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.720595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dbbab-7733-4d7b-b385-bd5adb8a56c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.721383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dbbab-7733-4d7b-b385-bd5adb8a56c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:09.721836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dbbab-7733-4d7b-b385-bd5adb8a56c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.722860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: WARNING py.warnings [None req-e19dbbab-7733-4d7b-b385-bd5adb8a56c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:13:09.722860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:13:09.722860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: Jun 20 06:13:09.723757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19dbbab-7733-4d7b-b385-bd5adb8a56c5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.726944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 775/1552] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:09.727792 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8679cae-5986-42c2-bba7-9660d8ffeb57 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.738342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8679cae-5986-42c2-bba7-9660d8ffeb57 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.743868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a2200-521c-49d9-8824-caa985682d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.751070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 778/1553] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:09.751237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a2200-521c-49d9-8824-caa985682d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.751237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a2200-521c-49d9-8824-caa985682d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.751237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a2200-521c-49d9-8824-caa985682d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.751524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812d6eb-9b40-493a-ba6c-ef34c7c14f81 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.751524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812d6eb-9b40-493a-ba6c-ef34c7c14f81 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.751695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a2200-521c-49d9-8824-caa985682d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:09.751796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812d6eb-9b40-493a-ba6c-ef34c7c14f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.751901 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a2200-521c-49d9-8824-caa985682d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.751901 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a2200-521c-49d9-8824-caa985682d8a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.763847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 776/1554] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:09.765024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c812d6eb-9b40-493a-ba6c-ef34c7c14f81 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.765257 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd18bc-9ed3-492b-aa6c-fc75c37a4aeb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.765535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd18bc-9ed3-492b-aa6c-fc75c37a4aeb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.765816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd18bc-9ed3-492b-aa6c-fc75c37a4aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.766258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c812d6eb-9b40-493a-ba6c-ef34c7c14f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.775420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 779/1555] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.776696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdb434-af80-4f2b-9fc9-b9070c559772 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.776992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdb434-af80-4f2b-9fc9-b9070c559772 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.777279 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdb434-af80-4f2b-9fc9-b9070c559772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.783425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-21bd18bc-9ed3-492b-aa6c-fc75c37a4aeb None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.784666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-21bd18bc-9ed3-492b-aa6c-fc75c37a4aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.793381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 777/1556] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.794599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60249b-27ad-4f1b-864f-109887e83d98 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.794895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60249b-27ad-4f1b-864f-109887e83d98 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.795180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60249b-27ad-4f1b-864f-109887e83d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.796462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a1fdb434-af80-4f2b-9fc9-b9070c559772 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.797676 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a1fdb434-af80-4f2b-9fc9-b9070c559772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.806474 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 780/1557] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.807264 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdb434-af80-4f2b-9fc9-b9070c559772 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.814100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7c60249b-27ad-4f1b-864f-109887e83d98 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:09.815300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7c60249b-27ad-4f1b-864f-109887e83d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.816785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdb434-af80-4f2b-9fc9-b9070c559772 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.821662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38c404-828b-4fff-b85a-2658c172d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.822307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38c404-828b-4fff-b85a-2658c172d7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.822595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38c404-828b-4fff-b85a-2658c172d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.822903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38c404-828b-4fff-b85a-2658c172d7bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.823383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 778/1558] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:09.823660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38c404-828b-4fff-b85a-2658c172d7bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:09.823969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38c404-828b-4fff-b85a-2658c172d7bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.824138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60249b-27ad-4f1b-864f-109887e83d98 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.825643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38c404-828b-4fff-b85a-2658c172d7bc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.833465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60249b-27ad-4f1b-864f-109887e83d98 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.838347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 781/1559] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:09.838490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1fbe-9eca-49a2-98dc-8bab4bf8c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.838981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1fbe-9eca-49a2-98dc-8bab4bf8c0bd admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.839105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38c404-828b-4fff-b85a-2658c172d7bc admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.839283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1fbe-9eca-49a2-98dc-8bab4bf8c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.839545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1fbe-9eca-49a2-98dc-8bab4bf8c0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.840226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b1fbe-9eca-49a2-98dc-8bab4bf8c0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.841271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: WARNING py.warnings [None req-0f5b1fbe-9eca-49a2-98dc-8bab4bf8c0bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:13:09.841271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: warnings.warn(msg) Jun 20 06:13:09.841271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: Jun 20 06:13:09.842479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b1fbe-9eca-49a2-98dc-8bab4bf8c0bd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.855918 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38c404-828b-4fff-b85a-2658c172d7bc admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.861197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ff3fd-898c-4991-9070-a5c06354460b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.861908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ff3fd-898c-4991-9070-a5c06354460b admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.862213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ff3fd-898c-4991-9070-a5c06354460b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.862684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ff3fd-898c-4991-9070-a5c06354460b admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.863276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ff3fd-898c-4991-9070-a5c06354460b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.865456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ff3fd-898c-4991-9070-a5c06354460b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.871184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 779/1560] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:09.871836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1fbe-9eca-49a2-98dc-8bab4bf8c0bd admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.896835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 782/1561] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:09.897722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ff3fd-898c-4991-9070-a5c06354460b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:09.943878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1fbe-9eca-49a2-98dc-8bab4bf8c0bd admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.961301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ff3fd-898c-4991-9070-a5c06354460b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:09.966158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99704b3d-db50-40c6-be78-a417815b3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:09.966844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99704b3d-db50-40c6-be78-a417815b3154 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:09.967138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99704b3d-db50-40c6-be78-a417815b3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:09.967423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99704b3d-db50-40c6-be78-a417815b3154 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:09.968200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99704b3d-db50-40c6-be78-a417815b3154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:09.969075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99704b3d-db50-40c6-be78-a417815b3154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.971307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99704b3d-db50-40c6-be78-a417815b3154 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.985525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 783/1562] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:09.986395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99704b3d-db50-40c6-be78-a417815b3154 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.002230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99704b3d-db50-40c6-be78-a417815b3154 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.005654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7838c3-04be-4a83-a104-329323a67a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.006331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7838c3-04be-4a83-a104-329323a67a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.006662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7838c3-04be-4a83-a104-329323a67a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.007272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7838c3-04be-4a83-a104-329323a67a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.007594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a10fde-bf3c-4520-b234-1e4b71b0300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.007983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7838c3-04be-4a83-a104-329323a67a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.008284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a10fde-bf3c-4520-b234-1e4b71b0300b admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.008573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a10fde-bf3c-4520-b234-1e4b71b0300b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.008892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a10fde-bf3c-4520-b234-1e4b71b0300b admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.009642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a10fde-bf3c-4520-b234-1e4b71b0300b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:10.009930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7838c3-04be-4a83-a104-329323a67a25 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.010039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a10fde-bf3c-4520-b234-1e4b71b0300b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.011567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a10fde-bf3c-4520-b234-1e4b71b0300b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.020160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:10.024385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 784/1563] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:10.024385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a10fde-bf3c-4520-b234-1e4b71b0300b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.035707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a10fde-bf3c-4520-b234-1e4b71b0300b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.040418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 780/1564] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:09 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.041413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fb3ca-a094-4700-8a64-8b195790eb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.041606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7838c3-04be-4a83-a104-329323a67a25 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.042123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fb3ca-a094-4700-8a64-8b195790eb7e admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.042409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fb3ca-a094-4700-8a64-8b195790eb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.042901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fb3ca-a094-4700-8a64-8b195790eb7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.043877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fb3ca-a094-4700-8a64-8b195790eb7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:10.044002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fb3ca-a094-4700-8a64-8b195790eb7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.045656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fb3ca-a094-4700-8a64-8b195790eb7e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.058199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 785/1565] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:10.059109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fb3ca-a094-4700-8a64-8b195790eb7e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.068423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fb3ca-a094-4700-8a64-8b195790eb7e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.092144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:10.110579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7838c3-04be-4a83-a104-329323a67a25 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.115225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ab965-52b9-44d0-a850-0d470e3b2447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.115890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ab965-52b9-44d0-a850-0d470e3b2447 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.116936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ab965-52b9-44d0-a850-0d470e3b2447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.117222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ab965-52b9-44d0-a850-0d470e3b2447 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.117951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ab965-52b9-44d0-a850-0d470e3b2447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:10.118321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ab965-52b9-44d0-a850-0d470e3b2447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.119929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ab965-52b9-44d0-a850-0d470e3b2447 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.126251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814051a4-b951-4135-a9ba-9db2430b13ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.126914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814051a4-b951-4135-a9ba-9db2430b13ab admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.127199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814051a4-b951-4135-a9ba-9db2430b13ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.127476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814051a4-b951-4135-a9ba-9db2430b13ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.128178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814051a4-b951-4135-a9ba-9db2430b13ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.130156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814051a4-b951-4135-a9ba-9db2430b13ab admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.131795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 781/1566] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:10.132456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ab965-52b9-44d0-a850-0d470e3b2447 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.142355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ab965-52b9-44d0-a850-0d470e3b2447 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.147188 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2875b1-f71e-4b08-9e3e-d640fbc86870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.148587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2875b1-f71e-4b08-9e3e-d640fbc86870 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.148900 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2875b1-f71e-4b08-9e3e-d640fbc86870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.149209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2875b1-f71e-4b08-9e3e-d640fbc86870 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.149893 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2875b1-f71e-4b08-9e3e-d640fbc86870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.151967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2875b1-f71e-4b08-9e3e-d640fbc86870 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.157826 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 786/1567] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.158753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814051a4-b951-4135-a9ba-9db2430b13ab admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.176849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 782/1568] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.177649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2875b1-f71e-4b08-9e3e-d640fbc86870 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.188892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2875b1-f71e-4b08-9e3e-d640fbc86870 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.225020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814051a4-b951-4135-a9ba-9db2430b13ab admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.230391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8d9db-6bec-427e-acbe-f8a947aa6f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.231071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8d9db-6bec-427e-acbe-f8a947aa6f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.231358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8d9db-6bec-427e-acbe-f8a947aa6f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.231637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8d9db-6bec-427e-acbe-f8a947aa6f63 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.232330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8d9db-6bec-427e-acbe-f8a947aa6f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.233403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: WARNING py.warnings [None req-08b8d9db-6bec-427e-acbe-f8a947aa6f63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:13:10.233403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:13:10.233403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: Jun 20 06:13:10.234632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8d9db-6bec-427e-acbe-f8a947aa6f63 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.247893 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e552f-38df-4360-b058-27593ca5d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.248697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e552f-38df-4360-b058-27593ca5d822 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.248994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e552f-38df-4360-b058-27593ca5d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.249349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e552f-38df-4360-b058-27593ca5d822 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.250642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e552f-38df-4360-b058-27593ca5d822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.252557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e552f-38df-4360-b058-27593ca5d822 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.256225 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 787/1569] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.257666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8d9db-6bec-427e-acbe-f8a947aa6f63 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.267069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8d9db-6bec-427e-acbe-f8a947aa6f63 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.272978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e04fe-da6a-4616-967d-71b9863e93b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.273924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e04fe-da6a-4616-967d-71b9863e93b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.274171 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e04fe-da6a-4616-967d-71b9863e93b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.274452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e04fe-da6a-4616-967d-71b9863e93b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.275181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e04fe-da6a-4616-967d-71b9863e93b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.277136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e04fe-da6a-4616-967d-71b9863e93b2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.280320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 783/1570] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.281225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e552f-38df-4360-b058-27593ca5d822 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.309589 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 788/1571] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.310499 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e04fe-da6a-4616-967d-71b9863e93b2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.336867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:10.347018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e552f-38df-4360-b058-27593ca5d822 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.376036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e04fe-da6a-4616-967d-71b9863e93b2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.380706 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18112473-02a7-44f5-b1b4-ba51fc6b31a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.381372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18112473-02a7-44f5-b1b4-ba51fc6b31a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.381751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18112473-02a7-44f5-b1b4-ba51fc6b31a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.382204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18112473-02a7-44f5-b1b4-ba51fc6b31a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.382886 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18112473-02a7-44f5-b1b4-ba51fc6b31a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.384971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18112473-02a7-44f5-b1b4-ba51fc6b31a9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.404098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14064b28-6fb5-4bbe-8078-01e2b0baa45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.404804 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14064b28-6fb5-4bbe-8078-01e2b0baa45a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.405114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14064b28-6fb5-4bbe-8078-01e2b0baa45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.405390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14064b28-6fb5-4bbe-8078-01e2b0baa45a admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.406069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14064b28-6fb5-4bbe-8078-01e2b0baa45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.407995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14064b28-6fb5-4bbe-8078-01e2b0baa45a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.410829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 789/1572] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.414244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18112473-02a7-44f5-b1b4-ba51fc6b31a9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.422013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:10.434978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 784/1573] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.434978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14064b28-6fb5-4bbe-8078-01e2b0baa45a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.452369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14064b28-6fb5-4bbe-8078-01e2b0baa45a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.492928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18112473-02a7-44f5-b1b4-ba51fc6b31a9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.497590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384eeff-c078-4c40-84c8-6c3f6bb3dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.498286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384eeff-c078-4c40-84c8-6c3f6bb3dfdf admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.498575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384eeff-c078-4c40-84c8-6c3f6bb3dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.498889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384eeff-c078-4c40-84c8-6c3f6bb3dfdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.499614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384eeff-c078-4c40-84c8-6c3f6bb3dfdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.501810 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384eeff-c078-4c40-84c8-6c3f6bb3dfdf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.517616 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57f9b2-2a1c-4e0c-ab7e-49fa2e3e7744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.518330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57f9b2-2a1c-4e0c-ab7e-49fa2e3e7744 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.518669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57f9b2-2a1c-4e0c-ab7e-49fa2e3e7744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.518902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57f9b2-2a1c-4e0c-ab7e-49fa2e3e7744 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.519591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57f9b2-2a1c-4e0c-ab7e-49fa2e3e7744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.521574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57f9b2-2a1c-4e0c-ab7e-49fa2e3e7744 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.530600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 790/1574] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.532259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384eeff-c078-4c40-84c8-6c3f6bb3dfdf admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.545078 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 785/1575] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.548833 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57f9b2-2a1c-4e0c-ab7e-49fa2e3e7744 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.558416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57f9b2-2a1c-4e0c-ab7e-49fa2e3e7744 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.598804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384eeff-c078-4c40-84c8-6c3f6bb3dfdf admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.603685 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a196e-5039-493e-b9ab-264be2ec39db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.604356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a196e-5039-493e-b9ab-264be2ec39db admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.604669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a196e-5039-493e-b9ab-264be2ec39db admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.604951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a196e-5039-493e-b9ab-264be2ec39db admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.605683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a196e-5039-493e-b9ab-264be2ec39db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.607295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a196e-5039-493e-b9ab-264be2ec39db admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.617222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 791/1576] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.621821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a196e-5039-493e-b9ab-264be2ec39db admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.621982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11e649-fb24-41c2-bfa5-262135bcf926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.621982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11e649-fb24-41c2-bfa5-262135bcf926 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.622164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11e649-fb24-41c2-bfa5-262135bcf926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.622384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11e649-fb24-41c2-bfa5-262135bcf926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.623144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11e649-fb24-41c2-bfa5-262135bcf926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.624826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11e649-fb24-41c2-bfa5-262135bcf926 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.631114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a196e-5039-493e-b9ab-264be2ec39db admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.636372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e8c6e-3b97-4ce2-90c1-9616ac74c8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.636562 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 786/1577] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.637535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11e649-fb24-41c2-bfa5-262135bcf926 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.639907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e8c6e-3b97-4ce2-90c1-9616ac74c8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.640207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e8c6e-3b97-4ce2-90c1-9616ac74c8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.640491 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e8c6e-3b97-4ce2-90c1-9616ac74c8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.641219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e8c6e-3b97-4ce2-90c1-9616ac74c8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.643150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e8c6e-3b97-4ce2-90c1-9616ac74c8c6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.646911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11e649-fb24-41c2-bfa5-262135bcf926 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.652142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fc8e2-45a1-4563-b0e2-50c74d34529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.652816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc8e2-45a1-4563-b0e2-50c74d34529e admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.653103 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc8e2-45a1-4563-b0e2-50c74d34529e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.653380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc8e2-45a1-4563-b0e2-50c74d34529e admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.654700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fc8e2-45a1-4563-b0e2-50c74d34529e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.657205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fc8e2-45a1-4563-b0e2-50c74d34529e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.667470 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 792/1578] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.667470 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e8c6e-3b97-4ce2-90c1-9616ac74c8c6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.675468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e8c6e-3b97-4ce2-90c1-9616ac74c8c6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.675961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:10.681677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca47793-ed99-4ad8-b2ce-ab37f013dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.682337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca47793-ed99-4ad8-b2ce-ab37f013dfd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.682632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca47793-ed99-4ad8-b2ce-ab37f013dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.682934 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca47793-ed99-4ad8-b2ce-ab37f013dfd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.683625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca47793-ed99-4ad8-b2ce-ab37f013dfd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.684143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 787/1579] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.684992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fc8e2-45a1-4563-b0e2-50c74d34529e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.685609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca47793-ed99-4ad8-b2ce-ab37f013dfd2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.695409 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fc8e2-45a1-4563-b0e2-50c74d34529e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.700500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22e4b-6f37-4845-94c3-e28ba38b4d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.701185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22e4b-6f37-4845-94c3-e28ba38b4d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.701475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22e4b-6f37-4845-94c3-e28ba38b4d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.701761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22e4b-6f37-4845-94c3-e28ba38b4d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.702489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb22e4b-6f37-4845-94c3-e28ba38b4d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.704109 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb22e4b-6f37-4845-94c3-e28ba38b4d0b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.707327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 793/1580] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.708181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca47793-ed99-4ad8-b2ce-ab37f013dfd2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.715407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 788/1581] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.716219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22e4b-6f37-4845-94c3-e28ba38b4d0b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.719286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca47793-ed99-4ad8-b2ce-ab37f013dfd2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.723935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb72a37-564d-4229-bbbe-9fbdfe94ac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.724589 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb72a37-564d-4229-bbbe-9fbdfe94ac3d admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.724911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb72a37-564d-4229-bbbe-9fbdfe94ac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.725185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb72a37-564d-4229-bbbe-9fbdfe94ac3d admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.727096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb72a37-564d-4229-bbbe-9fbdfe94ac3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.728158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22e4b-6f37-4845-94c3-e28ba38b4d0b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.729043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb72a37-564d-4229-bbbe-9fbdfe94ac3d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.732805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce9da3-6bc1-4446-ac46-166911815e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.733451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce9da3-6bc1-4446-ac46-166911815e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.733739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce9da3-6bc1-4446-ac46-166911815e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.734023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce9da3-6bc1-4446-ac46-166911815e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.734743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce9da3-6bc1-4446-ac46-166911815e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.736318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce9da3-6bc1-4446-ac46-166911815e5d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.747401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 789/1582] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.748057 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce9da3-6bc1-4446-ac46-166911815e5d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.750605 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 794/1583] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:10 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:10.751484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb72a37-564d-4229-bbbe-9fbdfe94ac3d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.758427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce9da3-6bc1-4446-ac46-166911815e5d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.761770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb72a37-564d-4229-bbbe-9fbdfe94ac3d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.763018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec68f2-0cd1-49c2-a233-0c47cb77399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.763666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec68f2-0cd1-49c2-a233-0c47cb77399b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.763952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec68f2-0cd1-49c2-a233-0c47cb77399b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.764237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec68f2-0cd1-49c2-a233-0c47cb77399b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.764983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec68f2-0cd1-49c2-a233-0c47cb77399b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.766475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddecf8-ce31-4dcb-856e-24e77b111695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.766620 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec68f2-0cd1-49c2-a233-0c47cb77399b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.767116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddecf8-ce31-4dcb-856e-24e77b111695 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.767399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddecf8-ce31-4dcb-856e-24e77b111695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.767670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddecf8-ce31-4dcb-856e-24e77b111695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.768379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddecf8-ce31-4dcb-856e-24e77b111695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.769990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddecf8-ce31-4dcb-856e-24e77b111695 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.776986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 790/1584] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.777789 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec68f2-0cd1-49c2-a233-0c47cb77399b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.783786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 795/1585] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.783786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddecf8-ce31-4dcb-856e-24e77b111695 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.787726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec68f2-0cd1-49c2-a233-0c47cb77399b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.792947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d3cfa-3ff2-4837-b99a-f8aa52eca33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.793592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3cfa-3ff2-4837-b99a-f8aa52eca33b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.793912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3cfa-3ff2-4837-b99a-f8aa52eca33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.794199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3cfa-3ff2-4837-b99a-f8aa52eca33b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.794367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddecf8-ce31-4dcb-856e-24e77b111695 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.794985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d3cfa-3ff2-4837-b99a-f8aa52eca33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.796523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d3cfa-3ff2-4837-b99a-f8aa52eca33b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.798979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5807b21-2836-4309-9c78-6bc61570638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.799615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5807b21-2836-4309-9c78-6bc61570638a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.800013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5807b21-2836-4309-9c78-6bc61570638a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.800413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5807b21-2836-4309-9c78-6bc61570638a admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.801248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5807b21-2836-4309-9c78-6bc61570638a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.802818 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5807b21-2836-4309-9c78-6bc61570638a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.808604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 791/1586] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.809434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d3cfa-3ff2-4837-b99a-f8aa52eca33b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.820567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 796/1587] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.820567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5807b21-2836-4309-9c78-6bc61570638a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.820867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d3cfa-3ff2-4837-b99a-f8aa52eca33b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.824765 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c16cd-98eb-4450-8a36-f387b1c4cee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.825425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c16cd-98eb-4450-8a36-f387b1c4cee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.825710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c16cd-98eb-4450-8a36-f387b1c4cee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.825997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c16cd-98eb-4450-8a36-f387b1c4cee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.826726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c16cd-98eb-4450-8a36-f387b1c4cee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.828322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c16cd-98eb-4450-8a36-f387b1c4cee7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.830157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5807b21-2836-4309-9c78-6bc61570638a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.835303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bbda1-cce2-48c5-9b31-fede742d82ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.835984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bbda1-cce2-48c5-9b31-fede742d82ff admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.836263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bbda1-cce2-48c5-9b31-fede742d82ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.836541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bbda1-cce2-48c5-9b31-fede742d82ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.837298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bbda1-cce2-48c5-9b31-fede742d82ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.838529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 792/1588] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.838875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bbda1-cce2-48c5-9b31-fede742d82ff admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.839310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c16cd-98eb-4450-8a36-f387b1c4cee7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.845525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:10.848794 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c16cd-98eb-4450-8a36-f387b1c4cee7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.853449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 797/1589] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.854796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bbda1-cce2-48c5-9b31-fede742d82ff admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.857417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e815e-a44b-4039-974b-f9a8a5b79f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.858100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e815e-a44b-4039-974b-f9a8a5b79f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.858416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e815e-a44b-4039-974b-f9a8a5b79f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.858697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e815e-a44b-4039-974b-f9a8a5b79f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.859429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e815e-a44b-4039-974b-f9a8a5b79f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.861139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e815e-a44b-4039-974b-f9a8a5b79f39 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.866762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bbda1-cce2-48c5-9b31-fede742d82ff admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.871619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410f7e-7053-464e-aba3-a90d7591f8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.872266 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410f7e-7053-464e-aba3-a90d7591f8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.872550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410f7e-7053-464e-aba3-a90d7591f8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.872874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e410f7e-7053-464e-aba3-a90d7591f8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.876122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 793/1590] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.876275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e410f7e-7053-464e-aba3-a90d7591f8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.876385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e815e-a44b-4039-974b-f9a8a5b79f39 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.876480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e410f7e-7053-464e-aba3-a90d7591f8d9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.884502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e815e-a44b-4039-974b-f9a8a5b79f39 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.889069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 798/1591] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:10.889069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410f7e-7053-464e-aba3-a90d7591f8d9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.889321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda6fee-ad86-42c7-b6de-ee658ea35226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.890090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda6fee-ad86-42c7-b6de-ee658ea35226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.890371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda6fee-ad86-42c7-b6de-ee658ea35226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.890646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda6fee-ad86-42c7-b6de-ee658ea35226 admin admin] PATH_INFO: `/v3/projects/c939b83bd07b4b72a1820e8f0b1de511/users/21d8d5c8b45d4d15a60a66b955dc9617/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.899488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e410f7e-7053-464e-aba3-a90d7591f8d9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:10.904330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c1402-e215-47a2-9536-53aafc2003f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:10.905464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c1402-e215-47a2-9536-53aafc2003f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:10.905815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c1402-e215-47a2-9536-53aafc2003f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:10.906080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c1402-e215-47a2-9536-53aafc2003f9 admin admin] PATH_INFO: `/v3/projects/fc06b9b3698c49fb880a426682efa178/users/b110e43ca19a4e4e8828c8b1d82b1a19/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:10.906255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda6fee-ad86-42c7-b6de-ee658ea35226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c939b83bd07b4b72a1820e8f0b1de511, user_id=21d8d5c8b45d4d15a60a66b955dc9617, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.907290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: WARNING py.warnings [None req-2eda6fee-ad86-42c7-b6de-ee658ea35226 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:13:10.907290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: warnings.warn(msg) Jun 20 06:13:10.907290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: Jun 20 06:13:10.909293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda6fee-ad86-42c7-b6de-ee658ea35226 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.923227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 794/1592] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:10 2022] PUT /identity/v3/projects/c939b83bd07b4b72a1820e8f0b1de511/users/21d8d5c8b45d4d15a60a66b955dc9617/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:10.923419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c1402-e215-47a2-9536-53aafc2003f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc06b9b3698c49fb880a426682efa178, user_id=b110e43ca19a4e4e8828c8b1d82b1a19, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:10.924030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda6fee-ad86-42c7-b6de-ee658ea35226 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.926496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c1402-e215-47a2-9536-53aafc2003f9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:10.939762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 799/1593] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:10 2022] PUT /identity/v3/projects/fc06b9b3698c49fb880a426682efa178/users/b110e43ca19a4e4e8828c8b1d82b1a19/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:10.940686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c1402-e215-47a2-9536-53aafc2003f9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:10.988781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda6fee-ad86-42c7-b6de-ee658ea35226 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.005458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c1402-e215-47a2-9536-53aafc2003f9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.010600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49a87f-297d-454c-bbdd-d65da4bf75a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.011286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49a87f-297d-454c-bbdd-d65da4bf75a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.011598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49a87f-297d-454c-bbdd-d65da4bf75a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.011914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49a87f-297d-454c-bbdd-d65da4bf75a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.012668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49a87f-297d-454c-bbdd-d65da4bf75a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.014294 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49a87f-297d-454c-bbdd-d65da4bf75a6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.025224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 800/1594] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:11.026175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49a87f-297d-454c-bbdd-d65da4bf75a6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.035893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49a87f-297d-454c-bbdd-d65da4bf75a6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.041620 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d1f0b-60b6-4fc6-94b7-78d00b371995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.042255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d1f0b-60b6-4fc6-94b7-78d00b371995 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.042562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d1f0b-60b6-4fc6-94b7-78d00b371995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.042844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d1f0b-60b6-4fc6-94b7-78d00b371995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.043555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d1f0b-60b6-4fc6-94b7-78d00b371995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.045177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d1f0b-60b6-4fc6-94b7-78d00b371995 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.046962 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5f17d-ac46-4a03-b969-8ff73d9aa37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.047635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5f17d-ac46-4a03-b969-8ff73d9aa37d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.047919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5f17d-ac46-4a03-b969-8ff73d9aa37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.048196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5f17d-ac46-4a03-b969-8ff73d9aa37d admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.048951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5f17d-ac46-4a03-b969-8ff73d9aa37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.050539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5f17d-ac46-4a03-b969-8ff73d9aa37d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.055191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 801/1595] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:11.056013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d1f0b-60b6-4fc6-94b7-78d00b371995 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.066500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 795/1596] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:11.066500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5f17d-ac46-4a03-b969-8ff73d9aa37d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.066751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d1f0b-60b6-4fc6-94b7-78d00b371995 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.071251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f0b4a-fa14-4b64-9761-c0659290d493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.072127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f0b4a-fa14-4b64-9761-c0659290d493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.072413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f0b4a-fa14-4b64-9761-c0659290d493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.072716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f0b4a-fa14-4b64-9761-c0659290d493 admin admin] PATH_INFO: `/v3/projects/0c67b7c1a98845cb81d84328e6e084e3/users/c9ea06c7648041d88aff6e58afcb8219/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.073769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5f17d-ac46-4a03-b969-8ff73d9aa37d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.078390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4cff0-20e2-4ba0-b3af-a6f6b7765c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.079039 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4cff0-20e2-4ba0-b3af-a6f6b7765c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.079331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4cff0-20e2-4ba0-b3af-a6f6b7765c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.079613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4cff0-20e2-4ba0-b3af-a6f6b7765c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.080332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4cff0-20e2-4ba0-b3af-a6f6b7765c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.081967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4cff0-20e2-4ba0-b3af-a6f6b7765c32 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.087728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:11.087931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f0b4a-fa14-4b64-9761-c0659290d493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c67b7c1a98845cb81d84328e6e084e3, user_id=c9ea06c7648041d88aff6e58afcb8219, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.091140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f0b4a-fa14-4b64-9761-c0659290d493 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.096191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 796/1597] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:11.096191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4cff0-20e2-4ba0-b3af-a6f6b7765c32 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.106309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 802/1598] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:11 2022] PUT /identity/v3/projects/0c67b7c1a98845cb81d84328e6e084e3/users/c9ea06c7648041d88aff6e58afcb8219/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:11.107930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412d963-1657-448f-b0a0-1efa695cb6ba None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.108089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4cff0-20e2-4ba0-b3af-a6f6b7765c32 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.108437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412d963-1657-448f-b0a0-1efa695cb6ba None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.108801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412d963-1657-448f-b0a0-1efa695cb6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.125419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b412d963-1657-448f-b0a0-1efa695cb6ba None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.126609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b412d963-1657-448f-b0a0-1efa695cb6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.166587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43534f-47f5-453a-9aaf-5d9de7262a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.167491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43534f-47f5-453a-9aaf-5d9de7262a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.167782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43534f-47f5-453a-9aaf-5d9de7262a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.168067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43534f-47f5-453a-9aaf-5d9de7262a10 admin admin] PATH_INFO: `/v3/projects/3e4470f91cc8421a822ff9bcafed1593/users/5fcd8e2432ef469299922ff57963fe83/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.182779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43534f-47f5-453a-9aaf-5d9de7262a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4470f91cc8421a822ff9bcafed1593, user_id=5fcd8e2432ef469299922ff57963fe83, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.185366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 803/1599] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:11.188450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43534f-47f5-453a-9aaf-5d9de7262a10 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.188587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4449391-f31f-447b-a552-1ddd366fa347 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.188587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4449391-f31f-447b-a552-1ddd366fa347 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.188587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4449391-f31f-447b-a552-1ddd366fa347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.202290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 797/1600] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:11 2022] PUT /identity/v3/projects/3e4470f91cc8421a822ff9bcafed1593/users/5fcd8e2432ef469299922ff57963fe83/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:11.212405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43534f-47f5-453a-9aaf-5d9de7262a10 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.217218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c4449391-f31f-447b-a552-1ddd366fa347 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.218435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c4449391-f31f-447b-a552-1ddd366fa347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.238896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:11.267452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43534f-47f5-453a-9aaf-5d9de7262a10 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.272259 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008978-c1c6-42ef-b26b-c468e1d4bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.273379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008978-c1c6-42ef-b26b-c468e1d4bbc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.273769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008978-c1c6-42ef-b26b-c468e1d4bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.274164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008978-c1c6-42ef-b26b-c468e1d4bbc5 admin admin] PATH_INFO: `/v3/projects/8a98f0e718204360b13bf2acc091573c/users/fdd594e606d6430d8c9594cc59348b12/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.278393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 804/1601] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:11.279209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4449391-f31f-447b-a552-1ddd366fa347 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.289504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4449391-f31f-447b-a552-1ddd366fa347 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.294248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac008978-c1c6-42ef-b26b-c468e1d4bbc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a98f0e718204360b13bf2acc091573c, user_id=fdd594e606d6430d8c9594cc59348b12, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.294395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d32772-2248-4403-97aa-12e042f2d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.295272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32772-2248-4403-97aa-12e042f2d2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.295567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32772-2248-4403-97aa-12e042f2d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.295856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32772-2248-4403-97aa-12e042f2d2ce admin admin] PATH_INFO: `/v3/projects/554ac8db86994f928c5465c5cf5dbf7b/users/233eab6eabcc44339cbd50d4aff1bd73/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.296973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac008978-c1c6-42ef-b26b-c468e1d4bbc5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.311277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 798/1602] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:11 2022] PUT /identity/v3/projects/8a98f0e718204360b13bf2acc091573c/users/fdd594e606d6430d8c9594cc59348b12/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:11.312207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008978-c1c6-42ef-b26b-c468e1d4bbc5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.313288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d32772-2248-4403-97aa-12e042f2d2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=554ac8db86994f928c5465c5cf5dbf7b, user_id=233eab6eabcc44339cbd50d4aff1bd73, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.316011 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d32772-2248-4403-97aa-12e042f2d2ce admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.331836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 805/1603] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:11 2022] PUT /identity/v3/projects/554ac8db86994f928c5465c5cf5dbf7b/users/233eab6eabcc44339cbd50d4aff1bd73/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:11.332762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d32772-2248-4403-97aa-12e042f2d2ce admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.391867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008978-c1c6-42ef-b26b-c468e1d4bbc5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.394207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d32772-2248-4403-97aa-12e042f2d2ce admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.396793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae37bc-731f-43e2-84f7-0aa7ab8ea87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.398242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae37bc-731f-43e2-84f7-0aa7ab8ea87c admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.398521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae37bc-731f-43e2-84f7-0aa7ab8ea87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.398795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae37bc-731f-43e2-84f7-0aa7ab8ea87c admin admin] PATH_INFO: `/v3/projects/32eeeff90a6c4ae7a6455e436a32415b/users/080c9080677b4fbeb73f82439eee5789/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.399258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac4b7a-2e3f-42ea-bda0-dd0d87a32503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.400198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac4b7a-2e3f-42ea-bda0-dd0d87a32503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.400492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac4b7a-2e3f-42ea-bda0-dd0d87a32503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.400849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac4b7a-2e3f-42ea-bda0-dd0d87a32503 admin admin] PATH_INFO: `/v3/projects/d52c906800e74c5f8b743ce98eb6372b/users/c17483c734a6435ea9599f15cab4a559/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.409757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:11.415552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae37bc-731f-43e2-84f7-0aa7ab8ea87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32eeeff90a6c4ae7a6455e436a32415b, user_id=080c9080677b4fbeb73f82439eee5789, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.416565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac4b7a-2e3f-42ea-bda0-dd0d87a32503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52c906800e74c5f8b743ce98eb6372b, user_id=c17483c734a6435ea9599f15cab4a559, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.419216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae37bc-731f-43e2-84f7-0aa7ab8ea87c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.419452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac4b7a-2e3f-42ea-bda0-dd0d87a32503 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.432274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 806/1604] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:11 2022] PUT /identity/v3/projects/d52c906800e74c5f8b743ce98eb6372b/users/c17483c734a6435ea9599f15cab4a559/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:11.433574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9611-b90b-40a3-823a-06e6502409fd None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.433871 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9611-b90b-40a3-823a-06e6502409fd None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.434157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9611-b90b-40a3-823a-06e6502409fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.434544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 799/1605] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:11 2022] PUT /identity/v3/projects/32eeeff90a6c4ae7a6455e436a32415b/users/080c9080677b4fbeb73f82439eee5789/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:11.435498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae37bc-731f-43e2-84f7-0aa7ab8ea87c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.454631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f71a9611-b90b-40a3-823a-06e6502409fd None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.455974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f71a9611-b90b-40a3-823a-06e6502409fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.491357 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae37bc-731f-43e2-84f7-0aa7ab8ea87c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.495368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dae7a-24cc-4b2c-9759-e483629da7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.496024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dae7a-24cc-4b2c-9759-e483629da7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.496315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dae7a-24cc-4b2c-9759-e483629da7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.496598 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dae7a-24cc-4b2c-9759-e483629da7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.516448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 807/1606] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:11.518371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cf3b0-67f5-46e3-a4ee-cc2d6a4b6d00 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.518600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cf3b0-67f5-46e3-a4ee-cc2d6a4b6d00 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.518887 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cf3b0-67f5-46e3-a4ee-cc2d6a4b6d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.546113 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b61cf3b0-67f5-46e3-a4ee-cc2d6a4b6d00 None None] MFA Rules not processed for user `5fcd8e2432ef469299922ff57963fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.547393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b61cf3b0-67f5-46e3-a4ee-cc2d6a4b6d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.558988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dae7a-24cc-4b2c-9759-e483629da7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.559944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:11.560429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dae7a-24cc-4b2c-9759-e483629da7d5 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.571430 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 800/1607] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:11.572245 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dae7a-24cc-4b2c-9759-e483629da7d5 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.580128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dae7a-24cc-4b2c-9759-e483629da7d5 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.584454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf87777-c07d-4b14-9431-359f4940e6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.584602 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf87777-c07d-4b14-9431-359f4940e6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.585003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf87777-c07d-4b14-9431-359f4940e6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.585288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf87777-c07d-4b14-9431-359f4940e6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.595507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf87777-c07d-4b14-9431-359f4940e6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.597179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf87777-c07d-4b14-9431-359f4940e6d9 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.609387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 801/1608] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:11.610558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcbdef-32de-4e3a-9243-98f9dfde3791 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.610874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcbdef-32de-4e3a-9243-98f9dfde3791 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.611128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcbdef-32de-4e3a-9243-98f9dfde3791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.624536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 808/1609] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:11.633292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30274d9f-bad7-4248-9981-c6899e7a33b5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.633601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30274d9f-bad7-4248-9981-c6899e7a33b5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.633962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30274d9f-bad7-4248-9981-c6899e7a33b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.655633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2adcbdef-32de-4e3a-9243-98f9dfde3791 None None] MFA Rules not processed for user `fdd594e606d6430d8c9594cc59348b12`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.656964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2adcbdef-32de-4e3a-9243-98f9dfde3791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.671003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-30274d9f-bad7-4248-9981-c6899e7a33b5 None None] MFA Rules not processed for user `233eab6eabcc44339cbd50d4aff1bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.672221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-30274d9f-bad7-4248-9981-c6899e7a33b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.734920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 802/1610] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:11.736534 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc808e-0af7-4e3d-ad82-ea663d21bec2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.737224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc808e-0af7-4e3d-ad82-ea663d21bec2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.737501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc808e-0af7-4e3d-ad82-ea663d21bec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.766101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-82dc808e-0af7-4e3d-ad82-ea663d21bec2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.767935 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-82dc808e-0af7-4e3d-ad82-ea663d21bec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.770187 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 809/1611] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:11.771927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f50365-6b7a-4bc0-a193-67f47322318e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.772055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f50365-6b7a-4bc0-a193-67f47322318e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.772458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f50365-6b7a-4bc0-a193-67f47322318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.787922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 803/1612] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:11.789861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc808e-0af7-4e3d-ad82-ea663d21bec2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.807883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc808e-0af7-4e3d-ad82-ea663d21bec2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.812542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8141179-0eda-49af-ad10-198527d62258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.813235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8141179-0eda-49af-ad10-198527d62258 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.813518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8141179-0eda-49af-ad10-198527d62258 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.813794 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8141179-0eda-49af-ad10-198527d62258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.822507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:11.826275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8141179-0eda-49af-ad10-198527d62258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.828375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-27f50365-6b7a-4bc0-a193-67f47322318e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.828593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8141179-0eda-49af-ad10-198527d62258 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.829983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-27f50365-6b7a-4bc0-a193-67f47322318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.840668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 810/1613] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:11.844204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 804/1614] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:11.845248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f50365-6b7a-4bc0-a193-67f47322318e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.845943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f320714-627e-4ac7-86cf-3a325bbd129a None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.846305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f320714-627e-4ac7-86cf-3a325bbd129a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.846694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f320714-627e-4ac7-86cf-3a325bbd129a None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.848625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 805/1615] 10.222.0.40 () {54 vars in 961 bytes} [Mon Jun 20 06:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:13:11.851631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f320714-627e-4ac7-86cf-3a325bbd129a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.853488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5f320714-627e-4ac7-86cf-3a325bbd129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:11.859699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f50365-6b7a-4bc0-a193-67f47322318e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.866960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaf521-6fa4-4851-8893-b7e69ed6c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.867734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaf521-6fa4-4851-8893-b7e69ed6c284 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.868119 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaf521-6fa4-4851-8893-b7e69ed6c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.868460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaf521-6fa4-4851-8893-b7e69ed6c284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.869265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfaf521-6fa4-4851-8893-b7e69ed6c284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.870599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f320714-627e-4ac7-86cf-3a325bbd129a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:11.871336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfaf521-6fa4-4851-8893-b7e69ed6c284 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.876650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae113e5b-8543-4a19-8be2-db6700643508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:11.877104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae113e5b-8543-4a19-8be2-db6700643508 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.877564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae113e5b-8543-4a19-8be2-db6700643508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.878603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae113e5b-8543-4a19-8be2-db6700643508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.889998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae113e5b-8543-4a19-8be2-db6700643508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:11.891527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae113e5b-8543-4a19-8be2-db6700643508 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:11.904591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 811/1616] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:11.904591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c32e38-454a-41ea-85b9-aeb028fdc9ed None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.904899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 806/1617] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:11.904990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c32e38-454a-41ea-85b9-aeb028fdc9ed None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.904990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c32e38-454a-41ea-85b9-aeb028fdc9ed None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.906272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 812/1618] 10.222.0.40 () {54 vars in 961 bytes} [Mon Jun 20 06:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:13:11.906403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6befbef-823b-4e61-b8a4-db2efe5f5b75 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:11.906564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c32e38-454a-41ea-85b9-aeb028fdc9ed None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:11.906715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6befbef-823b-4e61-b8a4-db2efe5f5b75 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:11.906715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6befbef-823b-4e61-b8a4-db2efe5f5b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:11.927957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c6befbef-823b-4e61-b8a4-db2efe5f5b75 None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:11.930094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c6befbef-823b-4e61-b8a4-db2efe5f5b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:12.000600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c32e38-454a-41ea-85b9-aeb028fdc9ed None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.008442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0421c-c1c0-4d2d-8b87-4138b8335224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.009948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0421c-c1c0-4d2d-8b87-4138b8335224 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.010083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0421c-c1c0-4d2d-8b87-4138b8335224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.010579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0421c-c1c0-4d2d-8b87-4138b8335224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.035687 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 807/1619] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Jun 20 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:12.037284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6befbef-823b-4e61-b8a4-db2efe5f5b75 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.057844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:12.128663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0421c-c1c0-4d2d-8b87-4138b8335224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.131093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0421c-c1c0-4d2d-8b87-4138b8335224 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.152578 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 813/1620] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:12.153990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2851c-f93b-4efe-983e-b49aa08af376 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.154287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2851c-f93b-4efe-983e-b49aa08af376 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.154591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2851c-f93b-4efe-983e-b49aa08af376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.166541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6befbef-823b-4e61-b8a4-db2efe5f5b75 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.173417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e1c0e-7745-4236-8d42-cd9ffe8dc6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.174382 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e1c0e-7745-4236-8d42-cd9ffe8dc6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.174676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e1c0e-7745-4236-8d42-cd9ffe8dc6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.174964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e1c0e-7745-4236-8d42-cd9ffe8dc6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.176466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e1c0e-7745-4236-8d42-cd9ffe8dc6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.180601 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e1c0e-7745-4236-8d42-cd9ffe8dc6a3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.189109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-9ec2851c-f93b-4efe-983e-b49aa08af376 None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:12.191348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9ec2851c-f93b-4efe-983e-b49aa08af376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:12.208492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 814/1621] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Jun 20 06:13:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:12.209906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2851c-f93b-4efe-983e-b49aa08af376 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.217025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 808/1622] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:12 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:12.218935 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e1c0e-7745-4236-8d42-cd9ffe8dc6a3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.224476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2851c-f93b-4efe-983e-b49aa08af376 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.233215 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e1c0e-7745-4236-8d42-cd9ffe8dc6a3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.235025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00773b-a0e9-4d67-8276-cf9f25d56e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.235703 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00773b-a0e9-4d67-8276-cf9f25d56e13 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.235994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00773b-a0e9-4d67-8276-cf9f25d56e13 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.236555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00773b-a0e9-4d67-8276-cf9f25d56e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.240305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1a992-6896-4338-9b24-6fde07b7fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.243014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1a992-6896-4338-9b24-6fde07b7fc7c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.243563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1a992-6896-4338-9b24-6fde07b7fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.244029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1a992-6896-4338-9b24-6fde07b7fc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.245151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1a992-6896-4338-9b24-6fde07b7fc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.247485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1a992-6896-4338-9b24-6fde07b7fc7c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.266954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 809/1623] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:12.268109 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1a992-6896-4338-9b24-6fde07b7fc7c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.286200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1a992-6896-4338-9b24-6fde07b7fc7c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.296309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1f0a2-f613-4a5d-aa19-7ab71f6afb1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.297366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f0a2-f613-4a5d-aa19-7ab71f6afb1a service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.297791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f0a2-f613-4a5d-aa19-7ab71f6afb1a service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.298112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f0a2-f613-4a5d-aa19-7ab71f6afb1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.321616 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00773b-a0e9-4d67-8276-cf9f25d56e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.324096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00773b-a0e9-4d67-8276-cf9f25d56e13 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.335492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 815/1624] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:12.336537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00773b-a0e9-4d67-8276-cf9f25d56e13 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.349577 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00773b-a0e9-4d67-8276-cf9f25d56e13 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.357096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e4015-77a7-4c9a-9228-62cf857c9c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.358889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e4015-77a7-4c9a-9228-62cf857c9c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.359183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e4015-77a7-4c9a-9228-62cf857c9c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.359468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e4015-77a7-4c9a-9228-62cf857c9c19 admin admin] PATH_INFO: `/v3/projects/55d0440aaaf74108b4deb2be744ca422/users/87601ad66b154fe2842d8afeebf5ce44/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.375713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:12.382088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e4015-77a7-4c9a-9228-62cf857c9c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d0440aaaf74108b4deb2be744ca422, user_id=87601ad66b154fe2842d8afeebf5ce44, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.387230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e4015-77a7-4c9a-9228-62cf857c9c19 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.406268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1f0a2-f613-4a5d-aa19-7ab71f6afb1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.409664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 816/1625] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:12 2022] PUT /identity/v3/projects/55d0440aaaf74108b4deb2be744ca422/users/87601ad66b154fe2842d8afeebf5ce44/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:12.414816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1f0a2-f613-4a5d-aa19-7ab71f6afb1a service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.415358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e4015-77a7-4c9a-9228-62cf857c9c19 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.434865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 810/1626] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:12.531852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e4015-77a7-4c9a-9228-62cf857c9c19 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.538851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c24805-f029-444c-abe3-42afb65a6f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.540083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c24805-f029-444c-abe3-42afb65a6f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.540643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c24805-f029-444c-abe3-42afb65a6f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.541009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c24805-f029-444c-abe3-42afb65a6f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.541961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c24805-f029-444c-abe3-42afb65a6f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.543921 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c24805-f029-444c-abe3-42afb65a6f17 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.560603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 817/1627] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:12.564662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1f0a2-f613-4a5d-aa19-7ab71f6afb1a service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.576826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1f0a2-f613-4a5d-aa19-7ab71f6afb1a service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.583199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d166d-b18c-4f56-8bdb-a3a1c9427d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.584557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d166d-b18c-4f56-8bdb-a3a1c9427d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.585593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d166d-b18c-4f56-8bdb-a3a1c9427d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.585950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d166d-b18c-4f56-8bdb-a3a1c9427d3d admin admin] PATH_INFO: `/v3/projects/55d0440aaaf74108b4deb2be744ca422/users/87601ad66b154fe2842d8afeebf5ce44/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.588399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d166d-b18c-4f56-8bdb-a3a1c9427d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d0440aaaf74108b4deb2be744ca422, user_id=87601ad66b154fe2842d8afeebf5ce44, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.591114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d166d-b18c-4f56-8bdb-a3a1c9427d3d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.605077 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 811/1628] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:12 2022] PUT /identity/v3/projects/55d0440aaaf74108b4deb2be744ca422/users/87601ad66b154fe2842d8afeebf5ce44/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:12.617583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f826-ab18-46a7-8049-eac12e0c9526 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.617912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f826-ab18-46a7-8049-eac12e0c9526 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.618201 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f826-ab18-46a7-8049-eac12e0c9526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.648702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4028f826-ab18-46a7-8049-eac12e0c9526 None None] MFA Rules not processed for user `87601ad66b154fe2842d8afeebf5ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:12.650197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4028f826-ab18-46a7-8049-eac12e0c9526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:12.674339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:12.744951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 818/1629] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:12.755654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d166d-b18c-4f56-8bdb-a3a1c9427d3d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:12.843329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e0af3-af33-4664-ba4f-da2665ad064e None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.843677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e0af3-af33-4664-ba4f-da2665ad064e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.844879 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e0af3-af33-4664-ba4f-da2665ad064e None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.847139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 819/1630] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jun 20 06:13:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:13:12.853878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5929d22-29ca-4377-91a5-d204bd186178 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.855295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5929d22-29ca-4377-91a5-d204bd186178 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.855589 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5929d22-29ca-4377-91a5-d204bd186178 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.855759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d166d-b18c-4f56-8bdb-a3a1c9427d3d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:12.857448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 820/1631] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jun 20 06:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:13:12.858713 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051ed1-cb6d-4fbd-9313-a7133399c1e6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.859007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051ed1-cb6d-4fbd-9313-a7133399c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.859294 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051ed1-cb6d-4fbd-9313-a7133399c1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.867355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389973c-cb1c-4e6d-91eb-632130b631a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:12.868517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389973c-cb1c-4e6d-91eb-632130b631a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.868989 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389973c-cb1c-4e6d-91eb-632130b631a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.869345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389973c-cb1c-4e6d-91eb-632130b631a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.886943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389973c-cb1c-4e6d-91eb-632130b631a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:12.888875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389973c-cb1c-4e6d-91eb-632130b631a5 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:12.901840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b1051ed1-cb6d-4fbd-9313-a7133399c1e6 None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:12.903696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b1051ed1-cb6d-4fbd-9313-a7133399c1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:12.917039 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 812/1632] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:12.918573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d766a-7c23-4cfe-815f-a3d5ac6fdffa None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:12.919185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d766a-7c23-4cfe-815f-a3d5ac6fdffa None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:12.919467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d766a-7c23-4cfe-815f-a3d5ac6fdffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:12.980450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-832d766a-7c23-4cfe-815f-a3d5ac6fdffa None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:12.981877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-832d766a-7c23-4cfe-815f-a3d5ac6fdffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:13.015747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 821/1633] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:13:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:13.032033 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1051ed1-cb6d-4fbd-9313-a7133399c1e6 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:13.050313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1051ed1-cb6d-4fbd-9313-a7133399c1e6 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:13.057609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2deb68-d29b-4524-866a-7bf15d557efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:13.060737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2deb68-d29b-4524-866a-7bf15d557efd service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:13.060976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2deb68-d29b-4524-866a-7bf15d557efd service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:13.062602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2deb68-d29b-4524-866a-7bf15d557efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:13.085558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2deb68-d29b-4524-866a-7bf15d557efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:13.089090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2deb68-d29b-4524-866a-7bf15d557efd service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:13.113096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 813/1634] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:13:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:13.114341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d766a-7c23-4cfe-815f-a3d5ac6fdffa None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:13.128215 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d766a-7c23-4cfe-815f-a3d5ac6fdffa None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:13.134766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7803b-4546-4907-a0bc-68a6168152f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:13.135401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7803b-4546-4907-a0bc-68a6168152f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:13.135750 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7803b-4546-4907-a0bc-68a6168152f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:13.136067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7803b-4546-4907-a0bc-68a6168152f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:13.139149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 822/1635] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:13.268475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7803b-4546-4907-a0bc-68a6168152f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:13.270213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7803b-4546-4907-a0bc-68a6168152f4 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:13.290053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 814/1636] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:13.375875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9ae8b-ec15-4356-80cf-38585bf74d7e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:13.376492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9ae8b-ec15-4356-80cf-38585bf74d7e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:13.376952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9ae8b-ec15-4356-80cf-38585bf74d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:13.430344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d1d9ae8b-ec15-4356-80cf-38585bf74d7e None None] MFA Rules not processed for user `b110e43ca19a4e4e8828c8b1d82b1a19`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:13.432779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d1d9ae8b-ec15-4356-80cf-38585bf74d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:13.578251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7803b-4546-4907-a0bc-68a6168152f4 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:13.591718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7803b-4546-4907-a0bc-68a6168152f4 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:13.599742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee65372-2041-4eb4-a177-23284b8e7dd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:13.600461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee65372-2041-4eb4-a177-23284b8e7dd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:13.600793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee65372-2041-4eb4-a177-23284b8e7dd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:13.601128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee65372-2041-4eb4-a177-23284b8e7dd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:13.620393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 823/1637] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:13.623955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9ae8b-ec15-4356-80cf-38585bf74d7e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:13.648751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee65372-2041-4eb4-a177-23284b8e7dd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:13.651071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee65372-2041-4eb4-a177-23284b8e7dd4 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:13.665735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:13.680068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 815/1638] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:13.718145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:13.825997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9ae8b-ec15-4356-80cf-38585bf74d7e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:13.838554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfe2ce-5e7f-424f-bc95-c65067196976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:13.839355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfe2ce-5e7f-424f-bc95-c65067196976 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:13.840395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfe2ce-5e7f-424f-bc95-c65067196976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:13.840395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfe2ce-5e7f-424f-bc95-c65067196976 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:13.840935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfe2ce-5e7f-424f-bc95-c65067196976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:13.843226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfe2ce-5e7f-424f-bc95-c65067196976 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:13.920754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 824/1639] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:13 2022] POST /identity/v3/projects => generated 405 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:13.924444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee65372-2041-4eb4-a177-23284b8e7dd4 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:13.945129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee65372-2041-4eb4-a177-23284b8e7dd4 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:14.128278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6e3d0-d892-46fb-a226-3ea783efe96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:14.129134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6e3d0-d892-46fb-a226-3ea783efe96b admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:14.129490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6e3d0-d892-46fb-a226-3ea783efe96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:14.129846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6e3d0-d892-46fb-a226-3ea783efe96b admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:14.130618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6e3d0-d892-46fb-a226-3ea783efe96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:14.132869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6e3d0-d892-46fb-a226-3ea783efe96b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:14.181921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 816/1640] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:13 2022] POST /identity/v3/users => generated 309 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:14.184419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfe2ce-5e7f-424f-bc95-c65067196976 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:14.208606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfe2ce-5e7f-424f-bc95-c65067196976 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:14.223665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0c59c-c2c4-4b89-9ba1-a876121c8649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:14.225211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c59c-c2c4-4b89-9ba1-a876121c8649 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:14.226562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c59c-c2c4-4b89-9ba1-a876121c8649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:14.227139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c59c-c2c4-4b89-9ba1-a876121c8649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:14.228273 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0c59c-c2c4-4b89-9ba1-a876121c8649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:14.230433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0c59c-c2c4-4b89-9ba1-a876121c8649 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:14.289242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 825/1641] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:14.289915 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6e3d0-d892-46fb-a226-3ea783efe96b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:14.307374 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6e3d0-d892-46fb-a226-3ea783efe96b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:14.325429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cfc29-ecb6-40cb-b326-f867da86d082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:14.326263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfc29-ecb6-40cb-b326-f867da86d082 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:14.326528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfc29-ecb6-40cb-b326-f867da86d082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:14.326829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfc29-ecb6-40cb-b326-f867da86d082 admin admin] PATH_INFO: `/v3/projects/91b599fc98b0414496d2f0a5d57c7525/users/d4dfe63a215e4dba9fbee3bb1c57b26c/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:14.372894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cfc29-ecb6-40cb-b326-f867da86d082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b599fc98b0414496d2f0a5d57c7525, user_id=d4dfe63a215e4dba9fbee3bb1c57b26c, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:14.376491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cfc29-ecb6-40cb-b326-f867da86d082 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:14.412527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 817/1642] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:14 2022] PUT /identity/v3/projects/91b599fc98b0414496d2f0a5d57c7525/users/d4dfe63a215e4dba9fbee3bb1c57b26c/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:14.416937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0c59c-c2c4-4b89-9ba1-a876121c8649 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:14.439380 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0c59c-c2c4-4b89-9ba1-a876121c8649 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:14.599364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e818d-6e6c-4cd1-b899-be50c4b35ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:14.601188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e818d-6e6c-4cd1-b899-be50c4b35ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:14.602363 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e818d-6e6c-4cd1-b899-be50c4b35ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:14.602838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e818d-6e6c-4cd1-b899-be50c4b35ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:14.603796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e818d-6e6c-4cd1-b899-be50c4b35ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:14.605701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e818d-6e6c-4cd1-b899-be50c4b35ff5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:14.637482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 826/1643] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:14.641638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cfc29-ecb6-40cb-b326-f867da86d082 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:14.658875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cfc29-ecb6-40cb-b326-f867da86d082 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:14.666663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47422f3f-a238-4019-9967-fb9de9b717fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:14.668387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47422f3f-a238-4019-9967-fb9de9b717fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:14.668969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47422f3f-a238-4019-9967-fb9de9b717fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:14.669505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47422f3f-a238-4019-9967-fb9de9b717fa admin admin] PATH_INFO: `/v3/projects/91b599fc98b0414496d2f0a5d57c7525/users/d4dfe63a215e4dba9fbee3bb1c57b26c/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:14.672491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47422f3f-a238-4019-9967-fb9de9b717fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b599fc98b0414496d2f0a5d57c7525, user_id=d4dfe63a215e4dba9fbee3bb1c57b26c, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:14.707772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47422f3f-a238-4019-9967-fb9de9b717fa admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:14.744073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 818/1644] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:14 2022] PUT /identity/v3/projects/91b599fc98b0414496d2f0a5d57c7525/users/d4dfe63a215e4dba9fbee3bb1c57b26c/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:17.434849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fd315-3d58-4135-b6d4-7b5a15eb22cc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:17.435455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fd315-3d58-4135-b6d4-7b5a15eb22cc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:17.435455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fd315-3d58-4135-b6d4-7b5a15eb22cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:17.507887 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d39fd315-3d58-4135-b6d4-7b5a15eb22cc None None] MFA Rules not processed for user `d4dfe63a215e4dba9fbee3bb1c57b26c`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:17.509204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d39fd315-3d58-4135-b6d4-7b5a15eb22cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:17.565929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47422f3f-a238-4019-9967-fb9de9b717fa admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:17.701477 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47422f3f-a238-4019-9967-fb9de9b717fa admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:17.708812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:17.710435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:17.710910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:17.711405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] PATH_INFO: `/v3/users/fdd594e606d6430d8c9594cc59348b12` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:17.713168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd594e606d6430d8c9594cc59348b12)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:17.714400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: WARNING py.warnings [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:13:17.714400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: warnings.warn(msg) Jun 20 06:13:17.714400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: Jun 20 06:13:17.716717 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:17.755275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 827/1645] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:17.829054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd594e606d6430d8c9594cc59348b12'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:17.843171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:17.850073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd594e606d6430d8c9594cc59348b12'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:17.852662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd594e606d6430d8c9594cc59348b12'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:17.853620 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd594e606d6430d8c9594cc59348b12'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:17.895448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd594e606d6430d8c9594cc59348b12'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:17.938102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbda424-7aab-4795-af53-3867b2aefb94 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:17.938549 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbda424-7aab-4795-af53-3867b2aefb94 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:17.938937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbda424-7aab-4795-af53-3867b2aefb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:17.940432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 819/1646] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:17 2022] DELETE /identity/v3/users/fdd594e606d6430d8c9594cc59348b12 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:17.978164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bcbda424-7aab-4795-af53-3867b2aefb94 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:17.981488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bcbda424-7aab-4795-af53-3867b2aefb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:18.026665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:18.216993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 828/1647] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:18.261603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:18.263975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:18.498973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62668900-36f5-4f5c-ad25-e04c1917b7ed admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:18.510955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9e746-c62a-4915-9133-3bf0e59c711e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:18.515090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e746-c62a-4915-9133-3bf0e59c711e service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:18.518040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e746-c62a-4915-9133-3bf0e59c711e service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:18.519518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e746-c62a-4915-9133-3bf0e59c711e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:18.622901 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9e746-c62a-4915-9133-3bf0e59c711e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:18.624396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9e746-c62a-4915-9133-3bf0e59c711e service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:18.675960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 820/1648] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:19.808861 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a719b-f76e-48ac-ade7-a4c15e19a2e3 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:19.811286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a719b-f76e-48ac-ade7-a4c15e19a2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:19.811770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a719b-f76e-48ac-ade7-a4c15e19a2e3 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:19.813475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 829/1649] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:13:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:13:19.931175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fa780-df58-43b3-8b0d-7b9740d7652c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:19.931711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fa780-df58-43b3-8b0d-7b9740d7652c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:19.931780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fa780-df58-43b3-8b0d-7b9740d7652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:19.968043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-802fa780-df58-43b3-8b0d-7b9740d7652c None None] MFA Rules not processed for user `577f89ef22954926bdf02a15484f8f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:19.976998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-802fa780-df58-43b3-8b0d-7b9740d7652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:20.341927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 821/1650] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:13:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:20.513936 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2a0d-afea-46f9-be3d-69bbba597f68 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:20.514220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2a0d-afea-46f9-be3d-69bbba597f68 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:20.514476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2a0d-afea-46f9-be3d-69bbba597f68 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:20.518440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 830/1651] 10.222.0.40 () {54 vars in 960 bytes} [Mon Jun 20 06:13:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:13:20.561825 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c66d3-59a6-4e9d-af72-63e93218628a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:20.563001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c66d3-59a6-4e9d-af72-63e93218628a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:20.564298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c66d3-59a6-4e9d-af72-63e93218628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:20.595687 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f81c66d3-59a6-4e9d-af72-63e93218628a None None] MFA Rules not processed for user `577f89ef22954926bdf02a15484f8f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:20.597461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f81c66d3-59a6-4e9d-af72-63e93218628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:20.632543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 822/1652] 10.222.0.40 () {58 vars in 1057 bytes} [Mon Jun 20 06:13:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:20.654635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2a0d-afea-46f9-be3d-69bbba597f68 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:20.690456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2a0d-afea-46f9-be3d-69bbba597f68 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:20.705676 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976905dd-65ba-497d-8328-b5f5126b96d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:20.706770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976905dd-65ba-497d-8328-b5f5126b96d6 service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:20.707252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976905dd-65ba-497d-8328-b5f5126b96d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:20.707741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976905dd-65ba-497d-8328-b5f5126b96d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:20.733636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976905dd-65ba-497d-8328-b5f5126b96d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:20.743257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976905dd-65ba-497d-8328-b5f5126b96d6 service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:20.771489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 831/1653] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:21.306583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c66d3-59a6-4e9d-af72-63e93218628a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:21.307989 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f81c66d3-59a6-4e9d-af72-63e93218628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:21.330582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c66d3-59a6-4e9d-af72-63e93218628a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:21.341605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:21.342685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:21.343141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:21.343560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] PATH_INFO: `/v3/projects/8a98f0e718204360b13bf2acc091573c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:21.347942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a98f0e718204360b13bf2acc091573c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:21.350830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:21.457822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a98f0e718204360b13bf2acc091573c', 'request_id': 'req-b546c17b-7e88-457e-8e5f-8a64a9042b84'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:21.483543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a98f0e718204360b13bf2acc091573c', 'request_id': 'req-b546c17b-7e88-457e-8e5f-8a64a9042b84'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:21.486829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:21.493198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a98f0e718204360b13bf2acc091573c', 'request_id': 'req-b546c17b-7e88-457e-8e5f-8a64a9042b84'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:21.543047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] The token cache is being invalidate because project 8a98f0e718204360b13bf2acc091573c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:21.543047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:21.552508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:21.552508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 823/1654] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:21 2022] DELETE /identity/v3/projects/8a98f0e718204360b13bf2acc091573c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:21.554518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1dcd-d3aa-4c4c-84af-af9b99d9de51 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:21.555198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1dcd-d3aa-4c4c-84af-af9b99d9de51 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:21.555198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1dcd-d3aa-4c4c-84af-af9b99d9de51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:21.611050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c1cb1dcd-d3aa-4c4c-84af-af9b99d9de51 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:21.612314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c1cb1dcd-d3aa-4c4c-84af-af9b99d9de51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:21.639096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:21.640710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:21.764212 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 832/1655] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:21.768269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b052-0d46-4ead-9be4-72c9e44c8a17 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:21.768552 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b052-0d46-4ead-9be4-72c9e44c8a17 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:21.768875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b052-0d46-4ead-9be4-72c9e44c8a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:21.812980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e308b052-0d46-4ead-9be4-72c9e44c8a17 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:21.818480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e308b052-0d46-4ead-9be4-72c9e44c8a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:21.828413 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546c17b-7e88-457e-8e5f-8a64a9042b84 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:21.837160 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 833/1656] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:21.842917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd097b8-ab7d-4e48-be8e-b89d9610b3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:21.843722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308b052-0d46-4ead-9be4-72c9e44c8a17 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:21.843828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd097b8-ab7d-4e48-be8e-b89d9610b3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:21.844118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd097b8-ab7d-4e48-be8e-b89d9610b3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:21.844398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd097b8-ab7d-4e48-be8e-b89d9610b3ac admin admin] PATH_INFO: `/v3/users/233eab6eabcc44339cbd50d4aff1bd73` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:21.846471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd097b8-ab7d-4e48-be8e-b89d9610b3ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=233eab6eabcc44339cbd50d4aff1bd73)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:21.848505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd097b8-ab7d-4e48-be8e-b89d9610b3ac admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:21.863671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308b052-0d46-4ead-9be4-72c9e44c8a17 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:21.879263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54691a72-c952-4dad-a13f-4fafad723b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:21.879968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54691a72-c952-4dad-a13f-4fafad723b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:21.880257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54691a72-c952-4dad-a13f-4fafad723b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:21.880535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54691a72-c952-4dad-a13f-4fafad723b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:21.881371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54691a72-c952-4dad-a13f-4fafad723b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:21.881778 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54691a72-c952-4dad-a13f-4fafad723b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:21.884602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54691a72-c952-4dad-a13f-4fafad723b3b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:21.916457 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 834/1657] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:21.920540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54691a72-c952-4dad-a13f-4fafad723b3b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:21.935767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54691a72-c952-4dad-a13f-4fafad723b3b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:21.962573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60683030-2b39-46ac-9276-e4400c0bc161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:21.963447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60683030-2b39-46ac-9276-e4400c0bc161 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:21.963792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60683030-2b39-46ac-9276-e4400c0bc161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:21.964273 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60683030-2b39-46ac-9276-e4400c0bc161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:21.965515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60683030-2b39-46ac-9276-e4400c0bc161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:21.968020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60683030-2b39-46ac-9276-e4400c0bc161 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:22.014547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1bd097b8-ab7d-4e48-be8e-b89d9610b3ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233eab6eabcc44339cbd50d4aff1bd73'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:22.037141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1bd097b8-ab7d-4e48-be8e-b89d9610b3ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233eab6eabcc44339cbd50d4aff1bd73'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:22.038274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1bd097b8-ab7d-4e48-be8e-b89d9610b3ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233eab6eabcc44339cbd50d4aff1bd73'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:22.040129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1bd097b8-ab7d-4e48-be8e-b89d9610b3ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233eab6eabcc44339cbd50d4aff1bd73'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:22.073040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 835/1658] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:21 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:22.075026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60683030-2b39-46ac-9276-e4400c0bc161 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:22.081774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-60683030-2b39-46ac-9276-e4400c0bc161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:22.082095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1bd097b8-ab7d-4e48-be8e-b89d9610b3ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233eab6eabcc44339cbd50d4aff1bd73'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:22.121971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 824/1659] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:21 2022] DELETE /identity/v3/users/233eab6eabcc44339cbd50d4aff1bd73 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:22.123791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ecbc-8970-479b-be69-571013e015f4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:22.124152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ecbc-8970-479b-be69-571013e015f4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:22.125366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ecbc-8970-479b-be69-571013e015f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:22.174759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f7c9ecbc-8970-479b-be69-571013e015f4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:22.175955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f7c9ecbc-8970-479b-be69-571013e015f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:22.262530 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60683030-2b39-46ac-9276-e4400c0bc161 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:22.265301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 825/1660] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:22.274281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a5fbc-ab00-4d07-b597-86f925340cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:22.275033 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a5fbc-ab00-4d07-b597-86f925340cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:22.275339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a5fbc-ab00-4d07-b597-86f925340cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:22.275617 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a5fbc-ab00-4d07-b597-86f925340cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:22.276324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a5fbc-ab00-4d07-b597-86f925340cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:22.278622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a5fbc-ab00-4d07-b597-86f925340cb4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:22.295141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:22.305278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9ecbc-8970-479b-be69-571013e015f4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:22.308757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f7c9ecbc-8970-479b-be69-571013e015f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:22.318189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:22.336335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 836/1661] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:22 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:22.337579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a5fbc-ab00-4d07-b597-86f925340cb4 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:22.367296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a5fbc-ab00-4d07-b597-86f925340cb4 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:22.381591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805049d-f2c5-4bfd-95a8-7fb9511f0ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:22.382304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805049d-f2c5-4bfd-95a8-7fb9511f0ded admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:22.382842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805049d-f2c5-4bfd-95a8-7fb9511f0ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:22.383329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805049d-f2c5-4bfd-95a8-7fb9511f0ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:22.385400 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805049d-f2c5-4bfd-95a8-7fb9511f0ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:22.389505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805049d-f2c5-4bfd-95a8-7fb9511f0ded admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:22.421529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 837/1662] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:22.422519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805049d-f2c5-4bfd-95a8-7fb9511f0ded admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:22.433453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9ecbc-8970-479b-be69-571013e015f4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:22.442408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805049d-f2c5-4bfd-95a8-7fb9511f0ded admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:22.453139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2214d-694c-439b-9ec8-56e7b28081c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:22.453822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2214d-694c-439b-9ec8-56e7b28081c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:22.454113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2214d-694c-439b-9ec8-56e7b28081c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:22.454396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2214d-694c-439b-9ec8-56e7b28081c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:22.455307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe2d18-a58c-40dd-8df3-0a43f2a38276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:22.456003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2d18-a58c-40dd-8df3-0a43f2a38276 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:22.456295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2d18-a58c-40dd-8df3-0a43f2a38276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:22.456584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2d18-a58c-40dd-8df3-0a43f2a38276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:22.457356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe2d18-a58c-40dd-8df3-0a43f2a38276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:22.459002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe2d18-a58c-40dd-8df3-0a43f2a38276 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:22.483374 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2214d-694c-439b-9ec8-56e7b28081c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:22.485777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2214d-694c-439b-9ec8-56e7b28081c7 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:22.489891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 838/1663] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:22.490857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe2d18-a58c-40dd-8df3-0a43f2a38276 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:22.508599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 826/1664] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:22.512591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe2d18-a58c-40dd-8df3-0a43f2a38276 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:22.517801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5dcfb-334a-49ad-b141-76be7dc40fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:22.518708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5dcfb-334a-49ad-b141-76be7dc40fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:22.519000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5dcfb-334a-49ad-b141-76be7dc40fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:22.519280 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5dcfb-334a-49ad-b141-76be7dc40fe5 admin admin] PATH_INFO: `/v3/projects/75aea138c30047eb9e3f9de60a6d63e6/users/3546d958bad54497b69285952902ef6e/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:22.536948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5dcfb-334a-49ad-b141-76be7dc40fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75aea138c30047eb9e3f9de60a6d63e6, user_id=3546d958bad54497b69285952902ef6e, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:22.541517 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5dcfb-334a-49ad-b141-76be7dc40fe5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:22.559473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 839/1665] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:22 2022] PUT /identity/v3/projects/75aea138c30047eb9e3f9de60a6d63e6/users/3546d958bad54497b69285952902ef6e/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:22.573448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bac43f-bbbb-4140-bf20-51d447d6939d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:22.574059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bac43f-bbbb-4140-bf20-51d447d6939d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:22.574454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bac43f-bbbb-4140-bf20-51d447d6939d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:22.621966 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-91bac43f-bbbb-4140-bf20-51d447d6939d None None] MFA Rules not processed for user `3546d958bad54497b69285952902ef6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:22.621966 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-91bac43f-bbbb-4140-bf20-51d447d6939d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:22.850664 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 827/1666] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:22.855028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5dcfb-334a-49ad-b141-76be7dc40fe5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:23.020953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5dcfb-334a-49ad-b141-76be7dc40fe5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:23.027957 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff438f4-78e9-4e18-b996-fab4c3f8d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:23.028899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff438f4-78e9-4e18-b996-fab4c3f8d564 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:23.029258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff438f4-78e9-4e18-b996-fab4c3f8d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:23.029612 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff438f4-78e9-4e18-b996-fab4c3f8d564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:23.031084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff438f4-78e9-4e18-b996-fab4c3f8d564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:23.034263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff438f4-78e9-4e18-b996-fab4c3f8d564 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:23.111258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 840/1667] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:22 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:23.112701 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bac43f-bbbb-4140-bf20-51d447d6939d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:23.167981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bac43f-bbbb-4140-bf20-51d447d6939d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:23.346279 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cfb38-2e51-4e77-bae6-e7bb6570f687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:23.347000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cfb38-2e51-4e77-bae6-e7bb6570f687 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:23.347266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cfb38-2e51-4e77-bae6-e7bb6570f687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:23.349054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cfb38-2e51-4e77-bae6-e7bb6570f687 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:23.349916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cfb38-2e51-4e77-bae6-e7bb6570f687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:23.357997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cfb38-2e51-4e77-bae6-e7bb6570f687 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:23.402753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 828/1668] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:23 2022] POST /identity/v3/users => generated 295 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:23.404359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff438f4-78e9-4e18-b996-fab4c3f8d564 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:23.427803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff438f4-78e9-4e18-b996-fab4c3f8d564 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:23.445650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccdceb-e0fb-48ff-a045-5df8ad935fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:23.448327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccdceb-e0fb-48ff-a045-5df8ad935fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:23.448904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccdceb-e0fb-48ff-a045-5df8ad935fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:23.451508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccdceb-e0fb-48ff-a045-5df8ad935fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:23.456561 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccdceb-e0fb-48ff-a045-5df8ad935fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:23.458380 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccdceb-e0fb-48ff-a045-5df8ad935fe3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:23.492984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 841/1669] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:23.493783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cfb38-2e51-4e77-bae6-e7bb6570f687 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:23.509283 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccdceb-e0fb-48ff-a045-5df8ad935fe3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:23.509694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cfb38-2e51-4e77-bae6-e7bb6570f687 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:23.511424 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-69ccdceb-e0fb-48ff-a045-5df8ad935fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:23.521769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e002e-9203-48ec-8bf0-400a3fce4252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:23.523565 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e002e-9203-48ec-8bf0-400a3fce4252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:23.523857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e002e-9203-48ec-8bf0-400a3fce4252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:23.524144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e002e-9203-48ec-8bf0-400a3fce4252 admin admin] PATH_INFO: `/v3/projects/5c4ce1cfefd1483e87f899a6f0d1ce60/users/3818d70668294c878ff6028649ef42d6/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:23.547232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccdceb-e0fb-48ff-a045-5df8ad935fe3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:23.567327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:23.568472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:23.569154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:23.569445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] PATH_INFO: `/v3/users/b110e43ca19a4e4e8828c8b1d82b1a19` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:23.570848 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b110e43ca19a4e4e8828c8b1d82b1a19)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:23.572835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:23.575937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e002e-9203-48ec-8bf0-400a3fce4252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4ce1cfefd1483e87f899a6f0d1ce60, user_id=3818d70668294c878ff6028649ef42d6, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:23.578985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e002e-9203-48ec-8bf0-400a3fce4252 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:23.613966 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 829/1670] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:23 2022] PUT /identity/v3/projects/5c4ce1cfefd1483e87f899a6f0d1ce60/users/3818d70668294c878ff6028649ef42d6/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:23.622662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e002e-9203-48ec-8bf0-400a3fce4252 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:23.632706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:23.696898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b110e43ca19a4e4e8828c8b1d82b1a19'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:23.712949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b110e43ca19a4e4e8828c8b1d82b1a19'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:23.713738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b110e43ca19a4e4e8828c8b1d82b1a19'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:23.714406 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b110e43ca19a4e4e8828c8b1d82b1a19'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:23.737907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b110e43ca19a4e4e8828c8b1d82b1a19'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:23.746072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:23.770314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 842/1671] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:23 2022] DELETE /identity/v3/users/b110e43ca19a4e4e8828c8b1d82b1a19 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:23.778323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e002e-9203-48ec-8bf0-400a3fce4252 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:23.900847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335624-d22e-47e8-a241-1d00d9c35a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:23.901698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335624-d22e-47e8-a241-1d00d9c35a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:23.901988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335624-d22e-47e8-a241-1d00d9c35a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:23.902270 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335624-d22e-47e8-a241-1d00d9c35a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:23.903105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335624-d22e-47e8-a241-1d00d9c35a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:23.905375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335624-d22e-47e8-a241-1d00d9c35a7c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:23.918397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 830/1672] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:23.922162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:23.923978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:23.942351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eba64-bc92-4e74-914d-664919d8a5b5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:23.948985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fcc69-9757-4e69-bb53-48ffdbb32769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:23.950565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fcc69-9757-4e69-bb53-48ffdbb32769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:23.951022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fcc69-9757-4e69-bb53-48ffdbb32769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:23.951510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fcc69-9757-4e69-bb53-48ffdbb32769 admin admin] PATH_INFO: `/v3/projects/5c4ce1cfefd1483e87f899a6f0d1ce60/users/3818d70668294c878ff6028649ef42d6/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:23.954400 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fcc69-9757-4e69-bb53-48ffdbb32769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4ce1cfefd1483e87f899a6f0d1ce60, user_id=3818d70668294c878ff6028649ef42d6, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:23.958177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fcc69-9757-4e69-bb53-48ffdbb32769 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:23.973529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 843/1673] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:23 2022] PUT /identity/v3/projects/5c4ce1cfefd1483e87f899a6f0d1ce60/users/3818d70668294c878ff6028649ef42d6/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:23.984274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858181de-7d95-4abe-a55c-e7fba72121ff None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:23.984576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858181de-7d95-4abe-a55c-e7fba72121ff None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:23.984892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858181de-7d95-4abe-a55c-e7fba72121ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:24.057152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-858181de-7d95-4abe-a55c-e7fba72121ff None None] MFA Rules not processed for user `3818d70668294c878ff6028649ef42d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:24.062076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-858181de-7d95-4abe-a55c-e7fba72121ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:24.236635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 831/1674] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:24.248375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fcc69-9757-4e69-bb53-48ffdbb32769 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:24.250245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cf2fcc69-9757-4e69-bb53-48ffdbb32769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:24.376308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fcc69-9757-4e69-bb53-48ffdbb32769 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:24.384123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be33fb-c00f-4014-b547-e3bddc531f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:24.384969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be33fb-c00f-4014-b547-e3bddc531f18 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:24.389161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be33fb-c00f-4014-b547-e3bddc531f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:24.389598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be33fb-c00f-4014-b547-e3bddc531f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:24.409577 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be33fb-c00f-4014-b547-e3bddc531f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:24.411776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be33fb-c00f-4014-b547-e3bddc531f18 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:24.436149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 844/1675] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:24.583096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858181de-7d95-4abe-a55c-e7fba72121ff None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:24.606142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858181de-7d95-4abe-a55c-e7fba72121ff None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:24.610333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7874d6-0cbd-429f-9a8a-6e4ebc8c7bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:24.611290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7874d6-0cbd-429f-9a8a-6e4ebc8c7bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:24.611776 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7874d6-0cbd-429f-9a8a-6e4ebc8c7bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:24.612267 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7874d6-0cbd-429f-9a8a-6e4ebc8c7bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:24.614632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-df7874d6-0cbd-429f-9a8a-6e4ebc8c7bc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:24.668019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:24.700576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be33fb-c00f-4014-b547-e3bddc531f18 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:24.702721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-73be33fb-c00f-4014-b547-e3bddc531f18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:24.786405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7874d6-0cbd-429f-9a8a-6e4ebc8c7bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:24.789603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7874d6-0cbd-429f-9a8a-6e4ebc8c7bc1 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:24.839785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 832/1676] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:24.841079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7874d6-0cbd-429f-9a8a-6e4ebc8c7bc1 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:24.847008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-df7874d6-0cbd-429f-9a8a-6e4ebc8c7bc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:24.988775 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be33fb-c00f-4014-b547-e3bddc531f18 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:25.005770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:25.008550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:25.008928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:25.009308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] PATH_INFO: `/v3/projects/554ac8db86994f928c5465c5cf5dbf7b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:25.013318 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=554ac8db86994f928c5465c5cf5dbf7b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:25.015791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: WARNING py.warnings [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:13:25.015791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: warnings.warn(msg) Jun 20 06:13:25.015791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: Jun 20 06:13:25.021540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:25.120856 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7874d6-0cbd-429f-9a8a-6e4ebc8c7bc1 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:25.149533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:25.151241 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:25.156000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:25.157273 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] PATH_INFO: `/v3/projects/fc06b9b3698c49fb880a426682efa178` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:25.162359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc06b9b3698c49fb880a426682efa178)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:25.168686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:25.217335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554ac8db86994f928c5465c5cf5dbf7b', 'request_id': 'req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.263359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554ac8db86994f928c5465c5cf5dbf7b', 'request_id': 'req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.278273 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554ac8db86994f928c5465c5cf5dbf7b', 'request_id': 'req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.313293 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] The token cache is being invalidate because project 554ac8db86994f928c5465c5cf5dbf7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:25.313885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.315718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f2f46beb-3b0a-457b-8acd-60c0bf6813ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.318510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc06b9b3698c49fb880a426682efa178', 'request_id': 'req-76eed8e8-cf55-47af-9ab7-b013db9959b0'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.333660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 845/1677] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:24 2022] DELETE /identity/v3/projects/554ac8db86994f928c5465c5cf5dbf7b => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:25.339682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7c554-c392-4285-8c88-861944906e93 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:25.340455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7c554-c392-4285-8c88-861944906e93 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:25.341582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7c554-c392-4285-8c88-861944906e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:25.351953 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc06b9b3698c49fb880a426682efa178', 'request_id': 'req-76eed8e8-cf55-47af-9ab7-b013db9959b0'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.368863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc06b9b3698c49fb880a426682efa178', 'request_id': 'req-76eed8e8-cf55-47af-9ab7-b013db9959b0'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.382493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1fd7c554-c392-4285-8c88-861944906e93 None None] MFA Rules not processed for user `21d8d5c8b45d4d15a60a66b955dc9617`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:25.384763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1fd7c554-c392-4285-8c88-861944906e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:25.391075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:25.395716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] The token cache is being invalidate because project fc06b9b3698c49fb880a426682efa178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:25.396017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.398310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-76eed8e8-cf55-47af-9ab7-b013db9959b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.401454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 833/1678] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:24 2022] DELETE /identity/v3/projects/fc06b9b3698c49fb880a426682efa178 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:25.406920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925433d-ff7c-43a6-b846-a34706a51d90 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:25.407251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925433d-ff7c-43a6-b846-a34706a51d90 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:25.407543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925433d-ff7c-43a6-b846-a34706a51d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:25.462624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b925433d-ff7c-43a6-b846-a34706a51d90 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:25.467522 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b925433d-ff7c-43a6-b846-a34706a51d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:25.497176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 846/1679] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:25.498302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7c554-c392-4285-8c88-861944906e93 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:25.501071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1fd7c554-c392-4285-8c88-861944906e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:25.602649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:25.607249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7c554-c392-4285-8c88-861944906e93 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:25.624972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82288a26-0774-4e4f-bf40-323106515a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:25.625983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82288a26-0774-4e4f-bf40-323106515a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:25.628130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 834/1680] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:25.629041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82288a26-0774-4e4f-bf40-323106515a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:25.629041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82288a26-0774-4e4f-bf40-323106515a8e admin admin] PATH_INFO: `/v3/users/d4dfe63a215e4dba9fbee3bb1c57b26c` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:25.630571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82288a26-0774-4e4f-bf40-323106515a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4dfe63a215e4dba9fbee3bb1c57b26c)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:25.630927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925433d-ff7c-43a6-b846-a34706a51d90 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:25.633481 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82288a26-0774-4e4f-bf40-323106515a8e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:25.634297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b925433d-ff7c-43a6-b846-a34706a51d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:25.713071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-82288a26-0774-4e4f-bf40-323106515a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4dfe63a215e4dba9fbee3bb1c57b26c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.724727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-82288a26-0774-4e4f-bf40-323106515a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4dfe63a215e4dba9fbee3bb1c57b26c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.726744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-82288a26-0774-4e4f-bf40-323106515a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4dfe63a215e4dba9fbee3bb1c57b26c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.727449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-82288a26-0774-4e4f-bf40-323106515a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4dfe63a215e4dba9fbee3bb1c57b26c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.766599 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-82288a26-0774-4e4f-bf40-323106515a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4dfe63a215e4dba9fbee3bb1c57b26c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:25.801598 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925433d-ff7c-43a6-b846-a34706a51d90 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:25.802963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 847/1681] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:25 2022] DELETE /identity/v3/users/d4dfe63a215e4dba9fbee3bb1c57b26c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:25.807429 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d432-460b-490c-a068-10b43304a1e5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:25.808499 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d432-460b-490c-a068-10b43304a1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:25.809036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d432-460b-490c-a068-10b43304a1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:25.858505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bdd1d432-460b-490c-a068-10b43304a1e5 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:25.860123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bdd1d432-460b-490c-a068-10b43304a1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:25.925076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:26.071399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 848/1682] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:26.076582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d432-460b-490c-a068-10b43304a1e5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:26.096757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a744425-3afd-422d-982a-06c749bdad68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:26.097451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a744425-3afd-422d-982a-06c749bdad68 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:26.097747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a744425-3afd-422d-982a-06c749bdad68 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:26.098029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a744425-3afd-422d-982a-06c749bdad68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:26.099827 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d432-460b-490c-a068-10b43304a1e5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:26.100034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6a744425-3afd-422d-982a-06c749bdad68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:26.123599 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bcfbc-de90-436c-8608-18700238ebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:26.124674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bcfbc-de90-436c-8608-18700238ebf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:26.125112 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bcfbc-de90-436c-8608-18700238ebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:26.125602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bcfbc-de90-436c-8608-18700238ebf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:26.126495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bcfbc-de90-436c-8608-18700238ebf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:26.127137 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bcfbc-de90-436c-8608-18700238ebf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:26.128994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bcfbc-de90-436c-8608-18700238ebf9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:26.165025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 849/1683] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:13:26.173749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bcfbc-de90-436c-8608-18700238ebf9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:26.196006 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bcfbc-de90-436c-8608-18700238ebf9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:26.212048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c1c66-559a-4348-b7bd-a711b4cb0c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:26.212951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1c66-559a-4348-b7bd-a711b4cb0c5b admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:26.212951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1c66-559a-4348-b7bd-a711b4cb0c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:26.213226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1c66-559a-4348-b7bd-a711b4cb0c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:26.213963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c1c66-559a-4348-b7bd-a711b4cb0c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:26.216226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c1c66-559a-4348-b7bd-a711b4cb0c5b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:26.261050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a744425-3afd-422d-982a-06c749bdad68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:26.262721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a744425-3afd-422d-982a-06c749bdad68 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:26.286360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 835/1684] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:26.308627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 850/1685] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:26 2022] POST /identity/v3/projects => generated 355 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:26.312721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a744425-3afd-422d-982a-06c749bdad68 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:26.336573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c1c66-559a-4348-b7bd-a711b4cb0c5b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:26.337994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a744425-3afd-422d-982a-06c749bdad68 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:26.340015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-da4c1c66-559a-4348-b7bd-a711b4cb0c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:26.451271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:26.532526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61632ac9-c1d2-489f-9396-eba528d250ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:26.533341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61632ac9-c1d2-489f-9396-eba528d250ee admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:26.536129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61632ac9-c1d2-489f-9396-eba528d250ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:26.537006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61632ac9-c1d2-489f-9396-eba528d250ee admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:26.540702 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61632ac9-c1d2-489f-9396-eba528d250ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:26.545337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61632ac9-c1d2-489f-9396-eba528d250ee admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:26.547565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c1c66-559a-4348-b7bd-a711b4cb0c5b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:26.564136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:26.566461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:26.566758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:26.567040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] PATH_INFO: `/v3/projects/91b599fc98b0414496d2f0a5d57c7525` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:26.570766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b599fc98b0414496d2f0a5d57c7525)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:26.580011 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:26.630403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 836/1686] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:26 2022] POST /identity/v3/users => generated 278 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:26.631878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61632ac9-c1d2-489f-9396-eba528d250ee admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:26.657709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61632ac9-c1d2-489f-9396-eba528d250ee admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:26.671587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c6f02-7162-4f07-a213-4cf86ad5571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:26.672745 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6f02-7162-4f07-a213-4cf86ad5571a admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:26.673056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6f02-7162-4f07-a213-4cf86ad5571a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:26.673314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c6f02-7162-4f07-a213-4cf86ad5571a admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:26.676307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c6f02-7162-4f07-a213-4cf86ad5571a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:26.678400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c6f02-7162-4f07-a213-4cf86ad5571a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:26.714148 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 837/1687] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:26.715492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c6f02-7162-4f07-a213-4cf86ad5571a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:26.729911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b599fc98b0414496d2f0a5d57c7525', 'request_id': 'req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:26.739494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c6f02-7162-4f07-a213-4cf86ad5571a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:26.744124 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b599fc98b0414496d2f0a5d57c7525', 'request_id': 'req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:26.754784 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b599fc98b0414496d2f0a5d57c7525', 'request_id': 'req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:26.769633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] The token cache is being invalidate because project 91b599fc98b0414496d2f0a5d57c7525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:26.769987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:26.770710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1b0b3aba-9ba9-4591-bdd3-ad453514dd79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:26.773579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 851/1688] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:26 2022] DELETE /identity/v3/projects/91b599fc98b0414496d2f0a5d57c7525 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:26.781913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b017c8-633d-4eca-96db-20ef459ae696 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:26.784755 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b017c8-633d-4eca-96db-20ef459ae696 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:26.785679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b017c8-633d-4eca-96db-20ef459ae696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:26.840929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d5b017c8-633d-4eca-96db-20ef459ae696 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:26.843489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d5b017c8-633d-4eca-96db-20ef459ae696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:26.881753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:26.917795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf343a0-8fa0-42ca-be9a-d40aba4e1c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:26.921337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf343a0-8fa0-42ca-be9a-d40aba4e1c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:26.922008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf343a0-8fa0-42ca-be9a-d40aba4e1c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:26.922468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf343a0-8fa0-42ca-be9a-d40aba4e1c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:26.923974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf343a0-8fa0-42ca-be9a-d40aba4e1c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:26.927294 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf343a0-8fa0-42ca-be9a-d40aba4e1c63 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:26.949903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 838/1689] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:26.953852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf343a0-8fa0-42ca-be9a-d40aba4e1c63 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:26.956181 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ccf343a0-8fa0-42ca-be9a-d40aba4e1c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:26.979087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf343a0-8fa0-42ca-be9a-d40aba4e1c63 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:26.985373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f6aad-ea75-4050-a29e-8260d0d5cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:26.986581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f6aad-ea75-4050-a29e-8260d0d5cd62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:26.986979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f6aad-ea75-4050-a29e-8260d0d5cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:26.987417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f6aad-ea75-4050-a29e-8260d0d5cd62 admin admin] PATH_INFO: `/v3/projects/cfbf0fe03dc24623a382a828da467bc5/users/50ce196df3a04bf6acd18f4cffbd6516/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.016436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f6aad-ea75-4050-a29e-8260d0d5cd62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfbf0fe03dc24623a382a828da467bc5, user_id=50ce196df3a04bf6acd18f4cffbd6516, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:27.020397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f6aad-ea75-4050-a29e-8260d0d5cd62 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:27.046171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 839/1690] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:26 2022] PUT /identity/v3/projects/cfbf0fe03dc24623a382a828da467bc5/users/50ce196df3a04bf6acd18f4cffbd6516/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:27.061683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 852/1691] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:27.071524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e2c4c-1ddb-4112-a4f0-05dd13d867d4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.073161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e2c4c-1ddb-4112-a4f0-05dd13d867d4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.074670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e170a0-9a63-42ac-b691-46b9095d7430 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.074930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e2c4c-1ddb-4112-a4f0-05dd13d867d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.081133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e170a0-9a63-42ac-b691-46b9095d7430 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.081653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e170a0-9a63-42ac-b691-46b9095d7430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.120992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-30e170a0-9a63-42ac-b691-46b9095d7430 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:27.122336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-30e170a0-9a63-42ac-b691-46b9095d7430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:27.155363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-347e2c4c-1ddb-4112-a4f0-05dd13d867d4 None None] MFA Rules not processed for user `50ce196df3a04bf6acd18f4cffbd6516`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:27.156597 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-347e2c4c-1ddb-4112-a4f0-05dd13d867d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:27.259075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 853/1692] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:27.260579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e170a0-9a63-42ac-b691-46b9095d7430 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:27.278118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e170a0-9a63-42ac-b691-46b9095d7430 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:27.291687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c77afc-8631-4ba6-b681-b3f68f89a8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:27.292622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77afc-8631-4ba6-b681-b3f68f89a8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.293024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77afc-8631-4ba6-b681-b3f68f89a8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.293501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77afc-8631-4ba6-b681-b3f68f89a8b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.294895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c77afc-8631-4ba6-b681-b3f68f89a8b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:27.294895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c77afc-8631-4ba6-b681-b3f68f89a8b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:27.297180 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c77afc-8631-4ba6-b681-b3f68f89a8b1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:27.328425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 854/1693] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:13:27.332518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c77afc-8631-4ba6-b681-b3f68f89a8b1 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:27.334281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 840/1694] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:27 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:27.340907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e2c4c-1ddb-4112-a4f0-05dd13d867d4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:27.345804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c77afc-8631-4ba6-b681-b3f68f89a8b1 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:27.361148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65868183-a39a-4408-bc26-085a58f21813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:27.362463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65868183-a39a-4408-bc26-085a58f21813 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.364499 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65868183-a39a-4408-bc26-085a58f21813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.365532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65868183-a39a-4408-bc26-085a58f21813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.370091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65868183-a39a-4408-bc26-085a58f21813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:27.371627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e2c4c-1ddb-4112-a4f0-05dd13d867d4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:27.375684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65868183-a39a-4408-bc26-085a58f21813 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:27.380163 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4fa00-2a3a-46fc-8960-a466ba5f3621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:27.381187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4fa00-2a3a-46fc-8960-a466ba5f3621 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.381698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4fa00-2a3a-46fc-8960-a466ba5f3621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.381698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4fa00-2a3a-46fc-8960-a466ba5f3621 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.382685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4fa00-2a3a-46fc-8960-a466ba5f3621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:27.388859 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4fa00-2a3a-46fc-8960-a466ba5f3621 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:27.409132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:27.443468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 855/1695] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:27 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:27.444997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65868183-a39a-4408-bc26-085a58f21813 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:27.454360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 841/1696] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:27 2022] POST /identity/v3/projects => generated 355 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:27.458027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4fa00-2a3a-46fc-8960-a466ba5f3621 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:27.571628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65868183-a39a-4408-bc26-085a58f21813 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:27.594646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4fa00-2a3a-46fc-8960-a466ba5f3621 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:27.604099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cab4c-3d9b-4306-baea-448db0b55835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:27.605045 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cab4c-3d9b-4306-baea-448db0b55835 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.605454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cab4c-3d9b-4306-baea-448db0b55835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.605818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cab4c-3d9b-4306-baea-448db0b55835 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.607060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cab4c-3d9b-4306-baea-448db0b55835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:27.611213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cab4c-3d9b-4306-baea-448db0b55835 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:27.641912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:27.656991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 842/1697] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:27 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:27.658914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40575b95-dce1-4dde-8f05-6f7f0c25d55a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.659360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40575b95-dce1-4dde-8f05-6f7f0c25d55a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.660564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40575b95-dce1-4dde-8f05-6f7f0c25d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.707456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95fc08-ba48-4458-a469-3286952b28ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:27.708167 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95fc08-ba48-4458-a469-3286952b28ff admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.708464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95fc08-ba48-4458-a469-3286952b28ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.708741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-40575b95-dce1-4dde-8f05-6f7f0c25d55a None None] MFA Rules not processed for user `c17483c734a6435ea9599f15cab4a559`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:27.708856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95fc08-ba48-4458-a469-3286952b28ff admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.709834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95fc08-ba48-4458-a469-3286952b28ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:27.710644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-40575b95-dce1-4dde-8f05-6f7f0c25d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:27.712173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95fc08-ba48-4458-a469-3286952b28ff admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:27.758627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 856/1698] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:27 2022] POST /identity/v3/users => generated 284 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:27.759585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95fc08-ba48-4458-a469-3286952b28ff admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:27.791410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95fc08-ba48-4458-a469-3286952b28ff admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:27.810960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b705-a978-4db6-b412-87f64b2b9d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:27.814399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b705-a978-4db6-b412-87f64b2b9d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.814754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b705-a978-4db6-b412-87f64b2b9d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.815042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b705-a978-4db6-b412-87f64b2b9d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.820582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332b705-a978-4db6-b412-87f64b2b9d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:27.822900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332b705-a978-4db6-b412-87f64b2b9d1a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:27.873753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 857/1699] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:27.879888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b705-a978-4db6-b412-87f64b2b9d1a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:27.905312 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 843/1700] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:27.917971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40575b95-dce1-4dde-8f05-6f7f0c25d55a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:27.919580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b705-a978-4db6-b412-87f64b2b9d1a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:27.932632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a51cf3-a0af-45c5-a53d-bf7a93b02ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:27.933333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51cf3-a0af-45c5-a53d-bf7a93b02ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.934503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51cf3-a0af-45c5-a53d-bf7a93b02ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.934799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51cf3-a0af-45c5-a53d-bf7a93b02ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.935659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a51cf3-a0af-45c5-a53d-bf7a93b02ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:27.940246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a51cf3-a0af-45c5-a53d-bf7a93b02ae2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:27.948940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40575b95-dce1-4dde-8f05-6f7f0c25d55a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:27.967544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383fa7-877d-407a-b4cd-559116aa12db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:27.967544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383fa7-877d-407a-b4cd-559116aa12db admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.967544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383fa7-877d-407a-b4cd-559116aa12db admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.970805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383fa7-877d-407a-b4cd-559116aa12db admin admin] PATH_INFO: `/v3/projects/3eb29b2d5291464397c72512a65bb59e/users/5c422848d43949cba31f40bc07ad7006/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.984263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 858/1701] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:27.984263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ee4b-8b5d-4195-a6c1-93b96cfb1a7a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.984263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ee4b-8b5d-4195-a6c1-93b96cfb1a7a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.984263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ee4b-8b5d-4195-a6c1-93b96cfb1a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:28.008895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66383fa7-877d-407a-b4cd-559116aa12db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb29b2d5291464397c72512a65bb59e, user_id=5c422848d43949cba31f40bc07ad7006, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:28.031110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66383fa7-877d-407a-b4cd-559116aa12db admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:28.048936 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b648ee4b-8b5d-4195-a6c1-93b96cfb1a7a None None] MFA Rules not processed for user `c17483c734a6435ea9599f15cab4a559`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:28.055357 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b648ee4b-8b5d-4195-a6c1-93b96cfb1a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:28.059072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 844/1702] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:27 2022] PUT /identity/v3/projects/3eb29b2d5291464397c72512a65bb59e/users/5c422848d43949cba31f40bc07ad7006/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:28.059072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383fa7-877d-407a-b4cd-559116aa12db admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:28.237749 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:28.302352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383fa7-877d-407a-b4cd-559116aa12db admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:28.328947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e8e0d-04c1-4a22-9741-41008e7e0078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:28.329657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e8e0d-04c1-4a22-9741-41008e7e0078 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:28.329939 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e8e0d-04c1-4a22-9741-41008e7e0078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:28.330211 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e8e0d-04c1-4a22-9741-41008e7e0078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:28.338383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e8e0d-04c1-4a22-9741-41008e7e0078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:28.340536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e8e0d-04c1-4a22-9741-41008e7e0078 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:28.345217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 859/1703] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:28.347082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648ee4b-8b5d-4195-a6c1-93b96cfb1a7a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:28.394057 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 845/1704] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:28.398293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e8e0d-04c1-4a22-9741-41008e7e0078 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:28.402124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-757e8e0d-04c1-4a22-9741-41008e7e0078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:28.413731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648ee4b-8b5d-4195-a6c1-93b96cfb1a7a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:28.441089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291411c-3fff-4df7-85d8-2b305a7a0ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:28.442199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291411c-3fff-4df7-85d8-2b305a7a0ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:28.442815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291411c-3fff-4df7-85d8-2b305a7a0ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:28.443125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291411c-3fff-4df7-85d8-2b305a7a0ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:28.444394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291411c-3fff-4df7-85d8-2b305a7a0ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:28.448008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291411c-3fff-4df7-85d8-2b305a7a0ddb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:28.487583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 860/1705] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:28.488495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291411c-3fff-4df7-85d8-2b305a7a0ddb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:28.528377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291411c-3fff-4df7-85d8-2b305a7a0ddb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:28.536299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ff8e5-e39f-4bdb-a572-1f5c58e99f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:28.537534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff8e5-e39f-4bdb-a572-1f5c58e99f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:28.538056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff8e5-e39f-4bdb-a572-1f5c58e99f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:28.538444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ff8e5-e39f-4bdb-a572-1f5c58e99f6f admin admin] PATH_INFO: `/v3/projects/63a3101b1f694c688f70ee8627c76069/users/fda961452a9847cea6075d01906298e5/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:28.633489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ff8e5-e39f-4bdb-a572-1f5c58e99f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a3101b1f694c688f70ee8627c76069, user_id=fda961452a9847cea6075d01906298e5, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:28.653809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ff8e5-e39f-4bdb-a572-1f5c58e99f6f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:28.727562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 861/1706] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:28 2022] PUT /identity/v3/projects/63a3101b1f694c688f70ee8627c76069/users/fda961452a9847cea6075d01906298e5/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:28.730665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ff8e5-e39f-4bdb-a572-1f5c58e99f6f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:28.738781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e8e0d-04c1-4a22-9741-41008e7e0078 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:29.039023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ff8e5-e39f-4bdb-a572-1f5c58e99f6f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:29.058940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b245bc8-097e-40a3-a199-24ffa1a91374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:29.059969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245bc8-097e-40a3-a199-24ffa1a91374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:29.060358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245bc8-097e-40a3-a199-24ffa1a91374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:29.060781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245bc8-097e-40a3-a199-24ffa1a91374 admin admin] PATH_INFO: `/v3/projects/3eb29b2d5291464397c72512a65bb59e/users/5c422848d43949cba31f40bc07ad7006/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:29.063355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b245bc8-097e-40a3-a199-24ffa1a91374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb29b2d5291464397c72512a65bb59e, user_id=5c422848d43949cba31f40bc07ad7006, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:29.064849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33200c91-8486-4b1d-a127-a514fbe42263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:29.065553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33200c91-8486-4b1d-a127-a514fbe42263 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:29.065836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33200c91-8486-4b1d-a127-a514fbe42263 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:29.066114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33200c91-8486-4b1d-a127-a514fbe42263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:29.066657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b245bc8-097e-40a3-a199-24ffa1a91374 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:29.078732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 862/1707] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:28 2022] PUT /identity/v3/projects/3eb29b2d5291464397c72512a65bb59e/users/5c422848d43949cba31f40bc07ad7006/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:29.080180 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72bb87-aaf6-4f35-9c03-a99cec52774a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:29.080578 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72bb87-aaf6-4f35-9c03-a99cec52774a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:29.080982 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72bb87-aaf6-4f35-9c03-a99cec52774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:29.098498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:29.170477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0e72bb87-aaf6-4f35-9c03-a99cec52774a None None] MFA Rules not processed for user `fda961452a9847cea6075d01906298e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:29.171813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0e72bb87-aaf6-4f35-9c03-a99cec52774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:29.276725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33200c91-8486-4b1d-a127-a514fbe42263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:29.293608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33200c91-8486-4b1d-a127-a514fbe42263 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:29.353017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 846/1708] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 958 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:29.360378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66274-d2ff-4fe5-93ee-702e39709be2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:29.360738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66274-d2ff-4fe5-93ee-702e39709be2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:29.361102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66274-d2ff-4fe5-93ee-702e39709be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:29.420805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 863/1709] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:29.425406 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72bb87-aaf6-4f35-9c03-a99cec52774a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:29.476062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-55d66274-d2ff-4fe5-93ee-702e39709be2 None None] MFA Rules not processed for user `5c422848d43949cba31f40bc07ad7006`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:29.485886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-55d66274-d2ff-4fe5-93ee-702e39709be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:29.519742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:29.592108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72bb87-aaf6-4f35-9c03-a99cec52774a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:29.597095 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59db4f1-1081-4ef0-98fb-9516ccf45668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:29.597792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59db4f1-1081-4ef0-98fb-9516ccf45668 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:29.598137 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59db4f1-1081-4ef0-98fb-9516ccf45668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:29.598421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59db4f1-1081-4ef0-98fb-9516ccf45668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:29.599268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59db4f1-1081-4ef0-98fb-9516ccf45668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:29.602024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59db4f1-1081-4ef0-98fb-9516ccf45668 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:29.673225 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 864/1710] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:29 2022] POST /identity/v3/projects => generated 369 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:29.678496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59db4f1-1081-4ef0-98fb-9516ccf45668 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:29.713516 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 847/1711] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:29 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:29.721988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d66274-d2ff-4fe5-93ee-702e39709be2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:29.723529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-55d66274-d2ff-4fe5-93ee-702e39709be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:29.835547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59db4f1-1081-4ef0-98fb-9516ccf45668 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:29.848767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff3f91-33fe-44d1-bdf8-516e6ac530d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:29.849951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff3f91-33fe-44d1-bdf8-516e6ac530d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:29.850999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff3f91-33fe-44d1-bdf8-516e6ac530d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:29.851700 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff3f91-33fe-44d1-bdf8-516e6ac530d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:29.852562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff3f91-33fe-44d1-bdf8-516e6ac530d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:29.856534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff3f91-33fe-44d1-bdf8-516e6ac530d6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:29.857865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d66274-d2ff-4fe5-93ee-702e39709be2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:29.913790 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 865/1712] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:29 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:29.916646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff3f91-33fe-44d1-bdf8-516e6ac530d6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:29.936664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff3f91-33fe-44d1-bdf8-516e6ac530d6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:29.951294 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7432c01-9893-4ba8-8428-4f08fbba1280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:29.952580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432c01-9893-4ba8-8428-4f08fbba1280 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:29.954525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432c01-9893-4ba8-8428-4f08fbba1280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:29.954956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432c01-9893-4ba8-8428-4f08fbba1280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:29.956805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7432c01-9893-4ba8-8428-4f08fbba1280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:29.962184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7432c01-9893-4ba8-8428-4f08fbba1280 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:29.974144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:30.003764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 866/1713] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:30.014820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7432c01-9893-4ba8-8428-4f08fbba1280 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:30.020410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71a8e7-70aa-4d0a-a450-ab0b82e8b6c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:30.024748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71a8e7-70aa-4d0a-a450-ab0b82e8b6c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:30.025236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71a8e7-70aa-4d0a-a450-ab0b82e8b6c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:30.025703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71a8e7-70aa-4d0a-a450-ab0b82e8b6c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:30.043007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7432c01-9893-4ba8-8428-4f08fbba1280 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:30.055841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd16e64-ccf7-4979-a05d-c1769dfd24d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:30.058144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd16e64-ccf7-4979-a05d-c1769dfd24d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:30.059260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd16e64-ccf7-4979-a05d-c1769dfd24d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:30.060544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd16e64-ccf7-4979-a05d-c1769dfd24d7 admin admin] PATH_INFO: `/v3/projects/1fdc5b2005b64245ac9a84a1b1383822/users/639c052485794759bad02a8fd0e00687/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:30.097321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd16e64-ccf7-4979-a05d-c1769dfd24d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdc5b2005b64245ac9a84a1b1383822, user_id=639c052485794759bad02a8fd0e00687, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:30.101976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd16e64-ccf7-4979-a05d-c1769dfd24d7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:30.133977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 867/1714] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:30 2022] PUT /identity/v3/projects/1fdc5b2005b64245ac9a84a1b1383822/users/639c052485794759bad02a8fd0e00687/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:30.138466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd16e64-ccf7-4979-a05d-c1769dfd24d7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:30.215300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71a8e7-70aa-4d0a-a450-ab0b82e8b6c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:30.216942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71a8e7-70aa-4d0a-a450-ab0b82e8b6c1 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:30.242135 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 848/1715] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:29 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:30.270334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd16e64-ccf7-4979-a05d-c1769dfd24d7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:30.277919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed3d85-872a-4fe0-9299-d5c809be2969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:30.278660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed3d85-872a-4fe0-9299-d5c809be2969 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:30.279027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed3d85-872a-4fe0-9299-d5c809be2969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:30.279309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed3d85-872a-4fe0-9299-d5c809be2969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:30.280131 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed3d85-872a-4fe0-9299-d5c809be2969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:30.281982 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed3d85-872a-4fe0-9299-d5c809be2969 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:30.299217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71a8e7-70aa-4d0a-a450-ab0b82e8b6c1 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:30.307699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 868/1716] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:30.313730 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71a8e7-70aa-4d0a-a450-ab0b82e8b6c1 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:30.327134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b5fc6-3177-434f-8abf-e2e9380a8cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:30.328351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b5fc6-3177-434f-8abf-e2e9380a8cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:30.328670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b5fc6-3177-434f-8abf-e2e9380a8cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:30.328941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b5fc6-3177-434f-8abf-e2e9380a8cd6 admin admin] PATH_INFO: `/v3/projects/1fdc5b2005b64245ac9a84a1b1383822/users/639c052485794759bad02a8fd0e00687/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:30.336094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b5fc6-3177-434f-8abf-e2e9380a8cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdc5b2005b64245ac9a84a1b1383822, user_id=639c052485794759bad02a8fd0e00687, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:30.339153 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b5fc6-3177-434f-8abf-e2e9380a8cd6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:30.354417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:30.365412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 849/1717] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:30 2022] PUT /identity/v3/projects/1fdc5b2005b64245ac9a84a1b1383822/users/639c052485794759bad02a8fd0e00687/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:30.377775 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f36d3-6aba-4039-a690-af53e406b1bf None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:30.378291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f36d3-6aba-4039-a690-af53e406b1bf None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:30.378516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f36d3-6aba-4039-a690-af53e406b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:30.445158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b36f36d3-6aba-4039-a690-af53e406b1bf None None] MFA Rules not processed for user `639c052485794759bad02a8fd0e00687`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:30.446448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b36f36d3-6aba-4039-a690-af53e406b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:30.482851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b5fc6-3177-434f-8abf-e2e9380a8cd6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:30.677339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 869/1718] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:30.683769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b5fc6-3177-434f-8abf-e2e9380a8cd6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:30.695711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238a63d-a741-4d7d-aead-687fae0b3a28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:30.697351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a63d-a741-4d7d-aead-687fae0b3a28 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:30.700237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a63d-a741-4d7d-aead-687fae0b3a28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:30.700862 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a63d-a741-4d7d-aead-687fae0b3a28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:30.781672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f36d3-6aba-4039-a690-af53e406b1bf None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:30.783619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b36f36d3-6aba-4039-a690-af53e406b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:30.801169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f36d3-6aba-4039-a690-af53e406b1bf None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:30.805375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473570b9-b5e8-4040-a30d-26b78a5f36b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:30.806240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473570b9-b5e8-4040-a30d-26b78a5f36b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:30.806675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473570b9-b5e8-4040-a30d-26b78a5f36b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:30.807394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473570b9-b5e8-4040-a30d-26b78a5f36b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:30.820210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473570b9-b5e8-4040-a30d-26b78a5f36b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:30.824035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473570b9-b5e8-4040-a30d-26b78a5f36b9 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:30.840320 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 870/1719] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:30.906814 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238a63d-a741-4d7d-aead-687fae0b3a28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:30.908343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238a63d-a741-4d7d-aead-687fae0b3a28 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:30.908479 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe19c-6057-4056-88fb-4412890e9ff8 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:30.909996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe19c-6057-4056-88fb-4412890e9ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:30.910672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe19c-6057-4056-88fb-4412890e9ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:30.944531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 850/1720] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:30 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:30.968200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e3dfe19c-6057-4056-88fb-4412890e9ff8 None None] MFA Rules not processed for user `21d8d5c8b45d4d15a60a66b955dc9617`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:30.970424 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e3dfe19c-6057-4056-88fb-4412890e9ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:31.035621 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:31.070522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 871/1721] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:31.141918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df313ce-5382-481d-84fd-9ead651fca09 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:31.142732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df313ce-5382-481d-84fd-9ead651fca09 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:31.142843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df313ce-5382-481d-84fd-9ead651fca09 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:31.144275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 851/1722] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jun 20 06:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:13:31.164362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ea98a-b5f2-48fd-9d64-c78fe8a883af None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:31.164861 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ea98a-b5f2-48fd-9d64-c78fe8a883af None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:31.165182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ea98a-b5f2-48fd-9d64-c78fe8a883af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:31.258584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4a4ea98a-b5f2-48fd-9d64-c78fe8a883af None None] MFA Rules not processed for user `9d21089ce5b140ab9549816b8cb38316`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:31.260096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4a4ea98a-b5f2-48fd-9d64-c78fe8a883af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:31.460896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 872/1723] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:13:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:31.550956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df313ce-5382-481d-84fd-9ead651fca09 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:31.553562 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4df313ce-5382-481d-84fd-9ead651fca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:31.600737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df313ce-5382-481d-84fd-9ead651fca09 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:31.611959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef2243-b7dc-474c-925d-95ee1830c0cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:31.612467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef2243-b7dc-474c-925d-95ee1830c0cc service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:31.612973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef2243-b7dc-474c-925d-95ee1830c0cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:31.614377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef2243-b7dc-474c-925d-95ee1830c0cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:31.659317 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef2243-b7dc-474c-925d-95ee1830c0cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:31.665474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef2243-b7dc-474c-925d-95ee1830c0cc service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:31.687727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 852/1724] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:32.689272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d1486-2c38-4b46-af05-d54037cdce23 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.693442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d1486-2c38-4b46-af05-d54037cdce23 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.694017 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d1486-2c38-4b46-af05-d54037cdce23 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.698390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 873/1725] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jun 20 06:13:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:13:32.705096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924004b4-e329-48e6-a0ff-e1fa543c82d8 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.706043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924004b4-e329-48e6-a0ff-e1fa543c82d8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.706613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924004b4-e329-48e6-a0ff-e1fa543c82d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.761927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-924004b4-e329-48e6-a0ff-e1fa543c82d8 None None] MFA Rules not processed for user `9d21089ce5b140ab9549816b8cb38316`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:32.766559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-924004b4-e329-48e6-a0ff-e1fa543c82d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:32.778336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 853/1726] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:13:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:32.797199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d1486-2c38-4b46-af05-d54037cdce23 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:32.803437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6b1d1486-2c38-4b46-af05-d54037cdce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:32.816548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46345910-1084-4807-917f-eb8bfca550f8 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.817260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46345910-1084-4807-917f-eb8bfca550f8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.817686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46345910-1084-4807-917f-eb8bfca550f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.847520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d1486-2c38-4b46-af05-d54037cdce23 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:32.864750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddad42-9ca5-4a06-87e9-0d8d2d324970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:32.867197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddad42-9ca5-4a06-87e9-0d8d2d324970 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:32.867682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddad42-9ca5-4a06-87e9-0d8d2d324970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:32.868118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddad42-9ca5-4a06-87e9-0d8d2d324970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:32.884513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddad42-9ca5-4a06-87e9-0d8d2d324970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:32.886434 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddad42-9ca5-4a06-87e9-0d8d2d324970 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:32.902216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-46345910-1084-4807-917f-eb8bfca550f8 None None] MFA Rules not processed for user `080c9080677b4fbeb73f82439eee5789`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:32.904070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-46345910-1084-4807-917f-eb8bfca550f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:32.927336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 874/1727] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:33.121420 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 854/1728] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:33.134877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77367d6d-ddf7-4dcf-9882-a566ceeb55f6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.135512 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77367d6d-ddf7-4dcf-9882-a566ceeb55f6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.136912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77367d6d-ddf7-4dcf-9882-a566ceeb55f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.189401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-77367d6d-ddf7-4dcf-9882-a566ceeb55f6 None None] MFA Rules not processed for user `080c9080677b4fbeb73f82439eee5789`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:33.190648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-77367d6d-ddf7-4dcf-9882-a566ceeb55f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:33.228115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 875/1729] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:33.342908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46345910-1084-4807-917f-eb8bfca550f8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:33.399143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:33.416629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f4d99-2718-4193-9610-ca36756f3ba5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.417153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f4d99-2718-4193-9610-ca36756f3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.417769 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f4d99-2718-4193-9610-ca36756f3ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.545408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a56f4d99-2718-4193-9610-ca36756f3ba5 None None] MFA Rules not processed for user `c9ea06c7648041d88aff6e58afcb8219`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:33.546654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a56f4d99-2718-4193-9610-ca36756f3ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:33.603432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46345910-1084-4807-917f-eb8bfca550f8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:33.622395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80617df8-4798-494f-a7f4-f82b21c2ff4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:33.623398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80617df8-4798-494f-a7f4-f82b21c2ff4b service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.625801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80617df8-4798-494f-a7f4-f82b21c2ff4b service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.626288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80617df8-4798-494f-a7f4-f82b21c2ff4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.658911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80617df8-4798-494f-a7f4-f82b21c2ff4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:33.665650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80617df8-4798-494f-a7f4-f82b21c2ff4b service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:33.705764 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 855/1730] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:33.707643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80617df8-4798-494f-a7f4-f82b21c2ff4b service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:33.711092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-80617df8-4798-494f-a7f4-f82b21c2ff4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:33.812045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 876/1731] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:33.995428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80617df8-4798-494f-a7f4-f82b21c2ff4b service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:34.001359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f7089-eca4-442e-883d-1fb9b7f07068 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:34.002367 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f7089-eca4-442e-883d-1fb9b7f07068 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:34.003112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f7089-eca4-442e-883d-1fb9b7f07068 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:34.003648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f7089-eca4-442e-883d-1fb9b7f07068 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:34.005958 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e25f7089-eca4-442e-883d-1fb9b7f07068 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:34.035433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f7089-eca4-442e-883d-1fb9b7f07068 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:34.037174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f7089-eca4-442e-883d-1fb9b7f07068 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:34.053895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 856/1732] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:34.323881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50dc4e-8024-4db4-9031-b21a37cf77d0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:34.324584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50dc4e-8024-4db4-9031-b21a37cf77d0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:34.325167 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50dc4e-8024-4db4-9031-b21a37cf77d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:34.336584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f7089-eca4-442e-883d-1fb9b7f07068 service placement] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:34.339932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e25f7089-eca4-442e-883d-1fb9b7f07068 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:34.373584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bd50dc4e-8024-4db4-9031-b21a37cf77d0 None None] MFA Rules not processed for user `c17483c734a6435ea9599f15cab4a559`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:34.374353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f7089-eca4-442e-883d-1fb9b7f07068 service placement] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:34.379311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bd50dc4e-8024-4db4-9031-b21a37cf77d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:34.390890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb60f5-01e2-4291-a0dc-b02edecc2f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:34.391985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb60f5-01e2-4291-a0dc-b02edecc2f20 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:34.392486 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb60f5-01e2-4291-a0dc-b02edecc2f20 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:34.393047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb60f5-01e2-4291-a0dc-b02edecc2f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:34.415417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb60f5-01e2-4291-a0dc-b02edecc2f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:34.417327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb60f5-01e2-4291-a0dc-b02edecc2f20 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:34.431625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 857/1733] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:34.617132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:34.651198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 877/1734] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:37.611689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb60f5-01e2-4291-a0dc-b02edecc2f20 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:37.614633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-07fb60f5-01e2-4291-a0dc-b02edecc2f20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:37.807753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb60f5-01e2-4291-a0dc-b02edecc2f20 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:37.824924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:37.827930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.829234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.831685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] PATH_INFO: `/v3/users/3546d958bad54497b69285952902ef6e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.833978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3546d958bad54497b69285952902ef6e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:37.841414 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:37.894645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:37.936203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3546d958bad54497b69285952902ef6e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:37.950525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3546d958bad54497b69285952902ef6e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:37.954886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3546d958bad54497b69285952902ef6e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:37.956700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3546d958bad54497b69285952902ef6e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.014048 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3546d958bad54497b69285952902ef6e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.057236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 858/1735] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:37 2022] DELETE /identity/v3/users/3546d958bad54497b69285952902ef6e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:38.061735 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bad3d2-e5ae-4f7a-b953-e864d7beb55e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.062939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bad3d2-e5ae-4f7a-b953-e864d7beb55e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.067188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bad3d2-e5ae-4f7a-b953-e864d7beb55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.181222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e1bad3d2-e5ae-4f7a-b953-e864d7beb55e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:38.184924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e1bad3d2-e5ae-4f7a-b953-e864d7beb55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:38.403710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 878/1736] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:38.446008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:38.450918 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bad3d2-e5ae-4f7a-b953-e864d7beb55e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:38.453852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e1bad3d2-e5ae-4f7a-b953-e864d7beb55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:38.456016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:38.530124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299a938-6644-41be-a790-709c3e15ee0b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:38.541004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74ec42-059b-4ab4-86d2-0a5ce77a0e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:38.542578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74ec42-059b-4ab4-86d2-0a5ce77a0e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.543244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74ec42-059b-4ab4-86d2-0a5ce77a0e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.543786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74ec42-059b-4ab4-86d2-0a5ce77a0e7d admin admin] PATH_INFO: `/v3/users/fda961452a9847cea6075d01906298e5` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.546523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74ec42-059b-4ab4-86d2-0a5ce77a0e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda961452a9847cea6075d01906298e5)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:38.549316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74ec42-059b-4ab4-86d2-0a5ce77a0e7d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:38.733080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bad3d2-e5ae-4f7a-b953-e864d7beb55e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:38.755374 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-dd74ec42-059b-4ab4-86d2-0a5ce77a0e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda961452a9847cea6075d01906298e5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.761649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ca063-cb35-4a97-a952-e4df71a6e917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:38.762581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ca063-cb35-4a97-a952-e4df71a6e917 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.762874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ca063-cb35-4a97-a952-e4df71a6e917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.763177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ca063-cb35-4a97-a952-e4df71a6e917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.780406 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-dd74ec42-059b-4ab4-86d2-0a5ce77a0e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda961452a9847cea6075d01906298e5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.781315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-dd74ec42-059b-4ab4-86d2-0a5ce77a0e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda961452a9847cea6075d01906298e5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.782345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-dd74ec42-059b-4ab4-86d2-0a5ce77a0e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda961452a9847cea6075d01906298e5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.821130 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ca063-cb35-4a97-a952-e4df71a6e917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:38.826743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ca063-cb35-4a97-a952-e4df71a6e917 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:38.852423 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-dd74ec42-059b-4ab4-86d2-0a5ce77a0e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda961452a9847cea6075d01906298e5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.876947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 879/1737] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:38.933126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 859/1738] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:38 2022] DELETE /identity/v3/users/fda961452a9847cea6075d01906298e5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:38.950531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d6fc1-90fc-4959-8393-5f46c41ef26f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.951537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d6fc1-90fc-4959-8393-5f46c41ef26f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.952497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d6fc1-90fc-4959-8393-5f46c41ef26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.009035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7e7d6fc1-90fc-4959-8393-5f46c41ef26f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:39.010784 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7e7d6fc1-90fc-4959-8393-5f46c41ef26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:39.156054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4e921-d77c-4839-a0e8-a5d2fd2f5572 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.156345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4e921-d77c-4839-a0e8-a5d2fd2f5572 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.156693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4e921-d77c-4839-a0e8-a5d2fd2f5572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.208285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 880/1739] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:39.253224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-40c4e921-d77c-4839-a0e8-a5d2fd2f5572 None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:39.253402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-40c4e921-d77c-4839-a0e8-a5d2fd2f5572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:39.430970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 860/1740] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:13:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:39.638960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d6fc1-90fc-4959-8393-5f46c41ef26f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.640491 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7e7d6fc1-90fc-4959-8393-5f46c41ef26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:39.766895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:39.769907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4e921-d77c-4839-a0e8-a5d2fd2f5572 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.772132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-40c4e921-d77c-4839-a0e8-a5d2fd2f5572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:39.795421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d6fc1-90fc-4959-8393-5f46c41ef26f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.800887 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9307911-5fa4-4bda-831d-4f3aa665e3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.801787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9307911-5fa4-4bda-831d-4f3aa665e3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.802169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9307911-5fa4-4bda-831d-4f3aa665e3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.802614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9307911-5fa4-4bda-831d-4f3aa665e3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.824350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9307911-5fa4-4bda-831d-4f3aa665e3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.824917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:39.827033 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9307911-5fa4-4bda-831d-4f3aa665e3d5 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:39.846076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 881/1741] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:39.954289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4e921-d77c-4839-a0e8-a5d2fd2f5572 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.963277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7f25c-e55a-4c15-b751-1c0fa26d2eeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.964314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7f25c-e55a-4c15-b751-1c0fa26d2eeb service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.964625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7f25c-e55a-4c15-b751-1c0fa26d2eeb service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.964924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7f25c-e55a-4c15-b751-1c0fa26d2eeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.994752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7f25c-e55a-4c15-b751-1c0fa26d2eeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.996384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7f25c-e55a-4c15-b751-1c0fa26d2eeb service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.019431 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 861/1742] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:13:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 06:13:41.554986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649a60-093f-4a25-afed-659fc8150be3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:41.555599 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649a60-093f-4a25-afed-659fc8150be3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:41.556032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649a60-093f-4a25-afed-659fc8150be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:41.613921 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a4649a60-093f-4a25-afed-659fc8150be3 None None] MFA Rules not processed for user `c9ea06c7648041d88aff6e58afcb8219`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:41.618850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a4649a60-093f-4a25-afed-659fc8150be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:41.716116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7f25c-e55a-4c15-b751-1c0fa26d2eeb service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:41.717773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-77e7f25c-e55a-4c15-b751-1c0fa26d2eeb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:41.767669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7f25c-e55a-4c15-b751-1c0fa26d2eeb service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:41.779878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 882/1743] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:41.796117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:41.797333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:41.805125 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:41.805618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] PATH_INFO: `/v3/projects/75aea138c30047eb9e3f9de60a6d63e6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:41.810731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] RBAC: Authorizing `identity:delete_project(project_id=75aea138c30047eb9e3f9de60a6d63e6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:41.816786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:41.978618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75aea138c30047eb9e3f9de60a6d63e6', 'request_id': 'req-95e26268-df11-448f-9d3d-abf646a5731a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:41.996536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75aea138c30047eb9e3f9de60a6d63e6', 'request_id': 'req-95e26268-df11-448f-9d3d-abf646a5731a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:42.010922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75aea138c30047eb9e3f9de60a6d63e6', 'request_id': 'req-95e26268-df11-448f-9d3d-abf646a5731a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:42.047686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] The token cache is being invalidate because project 75aea138c30047eb9e3f9de60a6d63e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:42.049151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:42.051219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-95e26268-df11-448f-9d3d-abf646a5731a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:42.056629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 862/1744] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:41 2022] DELETE /identity/v3/projects/75aea138c30047eb9e3f9de60a6d63e6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:42.060929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4649a60-093f-4a25-afed-659fc8150be3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:42.085796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4649a60-093f-4a25-afed-659fc8150be3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:42.243149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:42.244091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:42.244376 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:42.244673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] PATH_INFO: `/v3/users/3818d70668294c878ff6028649ef42d6` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:42.247802 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3818d70668294c878ff6028649ef42d6)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:42.249836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:42.408479 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3818d70668294c878ff6028649ef42d6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:42.430301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3818d70668294c878ff6028649ef42d6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:42.431878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3818d70668294c878ff6028649ef42d6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:42.432574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3818d70668294c878ff6028649ef42d6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:42.499354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3818d70668294c878ff6028649ef42d6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:42.540228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 883/1745] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:42 2022] DELETE /identity/v3/users/3818d70668294c878ff6028649ef42d6 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:43.114054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbeb36-c676-4e73-83c3-87eedf9e7e39 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:43.115190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbeb36-c676-4e73-83c3-87eedf9e7e39 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:43.116438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbeb36-c676-4e73-83c3-87eedf9e7e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:43.149888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-60bbeb36-c676-4e73-83c3-87eedf9e7e39 None None] MFA Rules not processed for user `9d21089ce5b140ab9549816b8cb38316`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:43.151788 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-60bbeb36-c676-4e73-83c3-87eedf9e7e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:43.272405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 863/1746] 10.222.0.33 () {58 vars in 1015 bytes} [Mon Jun 20 06:13:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:43.400258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:43.401839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:43.454114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c0312-670a-4c05-821f-4eef6a6f0a93 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:43.529904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f0df5-ba56-4d88-b2b3-873de38b4c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:43.530780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f0df5-ba56-4d88-b2b3-873de38b4c6a service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:43.532818 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f0df5-ba56-4d88-b2b3-873de38b4c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:43.533302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f0df5-ba56-4d88-b2b3-873de38b4c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:43.573846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:43.595968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f0df5-ba56-4d88-b2b3-873de38b4c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:43.599140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f0df5-ba56-4d88-b2b3-873de38b4c6a service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:43.666662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 884/1747] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:43.830136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbeb36-c676-4e73-83c3-87eedf9e7e39 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:43.832157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-60bbeb36-c676-4e73-83c3-87eedf9e7e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:43.981920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:44.018831 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbeb36-c676-4e73-83c3-87eedf9e7e39 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:44.028514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:44.031136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:44.032150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:44.034755 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] PATH_INFO: `/v3/projects/63a3101b1f694c688f70ee8627c76069` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:44.040478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a3101b1f694c688f70ee8627c76069)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:44.044393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:44.111793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a3101b1f694c688f70ee8627c76069', 'request_id': 'req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:44.120495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a3101b1f694c688f70ee8627c76069', 'request_id': 'req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:44.131195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a3101b1f694c688f70ee8627c76069', 'request_id': 'req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:44.166116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] The token cache is being invalidate because project 63a3101b1f694c688f70ee8627c76069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:44.166910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:44.167784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:44.169749 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 864/1748] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:43 2022] DELETE /identity/v3/projects/63a3101b1f694c688f70ee8627c76069 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:44.174493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f0df5-ba56-4d88-b2b3-873de38b4c6a service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:44.203787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f0df5-ba56-4d88-b2b3-873de38b4c6a service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:44.429547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fd240-045e-4e64-b41c-7d4572baf1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:44.432527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd240-045e-4e64-b41c-7d4572baf1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:44.433103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd240-045e-4e64-b41c-7d4572baf1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:44.433540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fd240-045e-4e64-b41c-7d4572baf1d6 admin admin] PATH_INFO: `/v3/users/639c052485794759bad02a8fd0e00687` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:44.435973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fd240-045e-4e64-b41c-7d4572baf1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=639c052485794759bad02a8fd0e00687)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:44.439507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fd240-045e-4e64-b41c-7d4572baf1d6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:44.556334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dc1fd240-045e-4e64-b41c-7d4572baf1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639c052485794759bad02a8fd0e00687'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:44.575125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dc1fd240-045e-4e64-b41c-7d4572baf1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639c052485794759bad02a8fd0e00687'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:44.576119 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dc1fd240-045e-4e64-b41c-7d4572baf1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639c052485794759bad02a8fd0e00687'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:44.576965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dc1fd240-045e-4e64-b41c-7d4572baf1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639c052485794759bad02a8fd0e00687'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:44.601897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-dc1fd240-045e-4e64-b41c-7d4572baf1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639c052485794759bad02a8fd0e00687'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:44.640311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 885/1749] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:44 2022] DELETE /identity/v3/users/639c052485794759bad02a8fd0e00687 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:45.735405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:45.737158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:45.779786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dcad3-fac9-4905-b1d9-0b40c2e13b99 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:46.087037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:46.091687 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:46.092025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:46.092412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] PATH_INFO: `/v3/projects/5c4ce1cfefd1483e87f899a6f0d1ce60` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:46.107496 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4ce1cfefd1483e87f899a6f0d1ce60)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:46.119241 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:46.263598 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4ce1cfefd1483e87f899a6f0d1ce60', 'request_id': 'req-5ac985f0-a773-43a5-89a8-3b1b6b62983e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:46.280890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4ce1cfefd1483e87f899a6f0d1ce60', 'request_id': 'req-5ac985f0-a773-43a5-89a8-3b1b6b62983e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:46.300632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4ce1cfefd1483e87f899a6f0d1ce60', 'request_id': 'req-5ac985f0-a773-43a5-89a8-3b1b6b62983e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:46.334046 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] The token cache is being invalidate because project 5c4ce1cfefd1483e87f899a6f0d1ce60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:46.335256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:46.337916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5ac985f0-a773-43a5-89a8-3b1b6b62983e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:46.344922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 865/1750] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:45 2022] DELETE /identity/v3/projects/5c4ce1cfefd1483e87f899a6f0d1ce60 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:46.350004 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbad410-efb6-4595-a898-4c3a58f26d55 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:46.351072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbad410-efb6-4595-a898-4c3a58f26d55 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:46.351583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbad410-efb6-4595-a898-4c3a58f26d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:46.400767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-fdbad410-efb6-4595-a898-4c3a58f26d55 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:46.406679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fdbad410-efb6-4595-a898-4c3a58f26d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:46.686310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 886/1751] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:46.697205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d18e-bf2f-455a-bd7a-cfc5d527627f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:46.697727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d18e-bf2f-455a-bd7a-cfc5d527627f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:46.698111 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d18e-bf2f-455a-bd7a-cfc5d527627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:46.719905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:46.787737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-10a2d18e-bf2f-455a-bd7a-cfc5d527627f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:46.800998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-10a2d18e-bf2f-455a-bd7a-cfc5d527627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:46.834263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 866/1752] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:46.839291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbad410-efb6-4595-a898-4c3a58f26d55 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:46.856541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbad410-efb6-4595-a898-4c3a58f26d55 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:46.893297 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74874a0-2c0f-4a4e-970e-9a392fb143a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:46.903253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74874a0-2c0f-4a4e-970e-9a392fb143a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:46.903638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74874a0-2c0f-4a4e-970e-9a392fb143a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:46.903936 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74874a0-2c0f-4a4e-970e-9a392fb143a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:46.904808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74874a0-2c0f-4a4e-970e-9a392fb143a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:46.905133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74874a0-2c0f-4a4e-970e-9a392fb143a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:46.919632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74874a0-2c0f-4a4e-970e-9a392fb143a5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:46.986213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2d18e-bf2f-455a-bd7a-cfc5d527627f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:46.989073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 887/1753] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:46.999561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2d18e-bf2f-455a-bd7a-cfc5d527627f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:47.018643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0831074-29db-468d-99a4-ffb84afc6ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:47.019511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0831074-29db-468d-99a4-ffb84afc6ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:47.019885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0831074-29db-468d-99a4-ffb84afc6ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:47.020170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0831074-29db-468d-99a4-ffb84afc6ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:47.020907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0831074-29db-468d-99a4-ffb84afc6ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:47.023700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0831074-29db-468d-99a4-ffb84afc6ddd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:47.121767 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 867/1754] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:46 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:47.122694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74874a0-2c0f-4a4e-970e-9a392fb143a5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:47.128671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:47.144134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74874a0-2c0f-4a4e-970e-9a392fb143a5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:47.329191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9081c-3d5c-4729-87c8-21a34d682a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:47.330102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9081c-3d5c-4729-87c8-21a34d682a8c admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:47.330399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9081c-3d5c-4729-87c8-21a34d682a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:47.330791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9081c-3d5c-4729-87c8-21a34d682a8c admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:47.331501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9081c-3d5c-4729-87c8-21a34d682a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:47.333640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9081c-3d5c-4729-87c8-21a34d682a8c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:47.367347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 888/1755] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:47 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:47.372102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0831074-29db-468d-99a4-ffb84afc6ddd admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:47.406771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0831074-29db-468d-99a4-ffb84afc6ddd admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:47.430796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a295bc-34c0-4e4b-a507-04f71f6e2006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:47.431998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a295bc-34c0-4e4b-a507-04f71f6e2006 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:47.433913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a295bc-34c0-4e4b-a507-04f71f6e2006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:47.434475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a295bc-34c0-4e4b-a507-04f71f6e2006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:47.435493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a295bc-34c0-4e4b-a507-04f71f6e2006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:47.443167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a295bc-34c0-4e4b-a507-04f71f6e2006 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:47.482928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9081c-3d5c-4729-87c8-21a34d682a8c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:47.503200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9081c-3d5c-4729-87c8-21a34d682a8c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:47.503703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 868/1756] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:47.522102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6a8ca-b7da-4da9-b135-fc23383bbfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:47.523339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a8ca-b7da-4da9-b135-fc23383bbfcd admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:47.523627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a8ca-b7da-4da9-b135-fc23383bbfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:47.523910 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a8ca-b7da-4da9-b135-fc23383bbfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:47.525913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6a8ca-b7da-4da9-b135-fc23383bbfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:47.528490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6a8ca-b7da-4da9-b135-fc23383bbfcd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:47.566645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a295bc-34c0-4e4b-a507-04f71f6e2006 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:47.576758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 889/1757] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:13:47.598293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a295bc-34c0-4e4b-a507-04f71f6e2006 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:47.609753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc0357-5edb-4c83-a293-a74970e25ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:47.610944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc0357-5edb-4c83-a293-a74970e25ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:47.611361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc0357-5edb-4c83-a293-a74970e25ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:47.611803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc0357-5edb-4c83-a293-a74970e25ffd admin admin] PATH_INFO: `/v3/projects/17785e7615eb4d3e8886f5373409f6a2/users/9d6f1c5cc5244df98a446ec9c747cb85/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:47.636802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc0357-5edb-4c83-a293-a74970e25ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=17785e7615eb4d3e8886f5373409f6a2, user_id=9d6f1c5cc5244df98a446ec9c747cb85, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:47.639839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc0357-5edb-4c83-a293-a74970e25ffd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:47.684922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 869/1758] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:47 2022] PUT /identity/v3/projects/17785e7615eb4d3e8886f5373409f6a2/users/9d6f1c5cc5244df98a446ec9c747cb85/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:47.699370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc0a7b-6f9f-491c-a974-ac58edf8a8aa None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:47.700178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc0a7b-6f9f-491c-a974-ac58edf8a8aa None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:47.700438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc0a7b-6f9f-491c-a974-ac58edf8a8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:47.765418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c6bc0a7b-6f9f-491c-a974-ac58edf8a8aa None None] MFA Rules not processed for user `9d6f1c5cc5244df98a446ec9c747cb85`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:47.766928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c6bc0a7b-6f9f-491c-a974-ac58edf8a8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:47.948239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 890/1759] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:47.954498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc0357-5edb-4c83-a293-a74970e25ffd admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.125331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc0357-5edb-4c83-a293-a74970e25ffd admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.135156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bf29e-64bb-4601-8ed5-86ea8c1412a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.135998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bf29e-64bb-4601-8ed5-86ea8c1412a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.139255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bf29e-64bb-4601-8ed5-86ea8c1412a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.139736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bf29e-64bb-4601-8ed5-86ea8c1412a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.140767 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bf29e-64bb-4601-8ed5-86ea8c1412a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.144903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bf29e-64bb-4601-8ed5-86ea8c1412a8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.207636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 870/1760] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:47 2022] POST /identity/v3/projects => generated 365 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:48.211261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc0a7b-6f9f-491c-a974-ac58edf8a8aa None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.242710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc0a7b-6f9f-491c-a974-ac58edf8a8aa None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.462686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bf29e-64bb-4601-8ed5-86ea8c1412a8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.464584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-457bf29e-64bb-4601-8ed5-86ea8c1412a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:48.497089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf3728-4471-4794-9515-ace777911872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.497900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf3728-4471-4794-9515-ace777911872 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.498188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf3728-4471-4794-9515-ace777911872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.498461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf3728-4471-4794-9515-ace777911872 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.499258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf3728-4471-4794-9515-ace777911872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.501312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf3728-4471-4794-9515-ace777911872 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.539035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:48.550173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 891/1761] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:48 2022] POST /identity/v3/users => generated 289 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:48.554509 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf3728-4471-4794-9515-ace777911872 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.584355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf3728-4471-4794-9515-ace777911872 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.614885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12e304-eda2-4ef2-8347-f7a8e5147f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.614885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12e304-eda2-4ef2-8347-f7a8e5147f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.614885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12e304-eda2-4ef2-8347-f7a8e5147f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.614885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12e304-eda2-4ef2-8347-f7a8e5147f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.615450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12e304-eda2-4ef2-8347-f7a8e5147f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.615450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12e304-eda2-4ef2-8347-f7a8e5147f39 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.638134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 892/1762] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:48.642926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12e304-eda2-4ef2-8347-f7a8e5147f39 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.674305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12e304-eda2-4ef2-8347-f7a8e5147f39 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.710162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddfa3e-a0fd-4e2c-ba6b-42150b66114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.711106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddfa3e-a0fd-4e2c-ba6b-42150b66114b admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.711397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddfa3e-a0fd-4e2c-ba6b-42150b66114b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.711687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddfa3e-a0fd-4e2c-ba6b-42150b66114b admin admin] PATH_INFO: `/v3/projects/882815b26bfb445fb56a3be385dcd568/users/14b469d0a518457ab2ddb1d9595c1bab/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.719801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bf29e-64bb-4601-8ed5-86ea8c1412a8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.726946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.728170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.728558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.728979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] PATH_INFO: `/v3/projects/1fdc5b2005b64245ac9a84a1b1383822` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.730743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fdc5b2005b64245ac9a84a1b1383822)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.733509 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.775514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddfa3e-a0fd-4e2c-ba6b-42150b66114b admin admin] RBAC: Authorizing `identity:create_grant(project_id=882815b26bfb445fb56a3be385dcd568, user_id=14b469d0a518457ab2ddb1d9595c1bab, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.794627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:48.799487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddfa3e-a0fd-4e2c-ba6b-42150b66114b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.825678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fdc5b2005b64245ac9a84a1b1383822', 'request_id': 'req-5e075915-321f-4f4d-8e51-321f09aac98f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:48.842150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fdc5b2005b64245ac9a84a1b1383822', 'request_id': 'req-5e075915-321f-4f4d-8e51-321f09aac98f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:48.844136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 893/1763] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:48 2022] PUT /identity/v3/projects/882815b26bfb445fb56a3be385dcd568/users/14b469d0a518457ab2ddb1d9595c1bab/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:48.849915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddfa3e-a0fd-4e2c-ba6b-42150b66114b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.856338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fdc5b2005b64245ac9a84a1b1383822', 'request_id': 'req-5e075915-321f-4f4d-8e51-321f09aac98f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:48.897836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] The token cache is being invalidate because project 1fdc5b2005b64245ac9a84a1b1383822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:48.898507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:48.900341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e075915-321f-4f4d-8e51-321f09aac98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:48.903213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 871/1764] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:48 2022] DELETE /identity/v3/projects/1fdc5b2005b64245ac9a84a1b1383822 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:48.921467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2d99b-af90-42f7-87c6-18f1ad91d3e2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.921882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2d99b-af90-42f7-87c6-18f1ad91d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.922974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2d99b-af90-42f7-87c6-18f1ad91d3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.984371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2cc2d99b-af90-42f7-87c6-18f1ad91d3e2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:48.984371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2cc2d99b-af90-42f7-87c6-18f1ad91d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:49.123151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddfa3e-a0fd-4e2c-ba6b-42150b66114b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:49.159114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 872/1765] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:49.159835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab8850-44a8-422e-b426-2f1e4fb2b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:49.160835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab8850-44a8-422e-b426-2f1e4fb2b2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:49.161127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab8850-44a8-422e-b426-2f1e4fb2b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:49.161412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab8850-44a8-422e-b426-2f1e4fb2b2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:49.162386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c97db-8d5c-4503-9220-14cdaad83619 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:49.162794 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c97db-8d5c-4503-9220-14cdaad83619 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:49.162994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab8850-44a8-422e-b426-2f1e4fb2b2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:49.163542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c97db-8d5c-4503-9220-14cdaad83619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:49.182688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab8850-44a8-422e-b426-2f1e4fb2b2f4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:49.219153 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-330c97db-8d5c-4503-9220-14cdaad83619 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:49.220539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-330c97db-8d5c-4503-9220-14cdaad83619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:49.230542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 894/1766] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:49.233745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab8850-44a8-422e-b426-2f1e4fb2b2f4 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:49.235432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d0ab8850-44a8-422e-b426-2f1e4fb2b2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:49.260952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 873/1767] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:49.262284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c97db-8d5c-4503-9220-14cdaad83619 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:49.265560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab8850-44a8-422e-b426-2f1e4fb2b2f4 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:49.273430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b914e54-ca32-4dc8-8ccb-1834ca9e395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:49.275780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b914e54-ca32-4dc8-8ccb-1834ca9e395b admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:49.276188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b914e54-ca32-4dc8-8ccb-1834ca9e395b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:49.276565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b914e54-ca32-4dc8-8ccb-1834ca9e395b admin admin] PATH_INFO: `/v3/projects/882815b26bfb445fb56a3be385dcd568/users/14b469d0a518457ab2ddb1d9595c1bab/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:49.284973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b914e54-ca32-4dc8-8ccb-1834ca9e395b admin admin] RBAC: Authorizing `identity:create_grant(project_id=882815b26bfb445fb56a3be385dcd568, user_id=14b469d0a518457ab2ddb1d9595c1bab, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:49.287379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c97db-8d5c-4503-9220-14cdaad83619 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:49.291866 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b914e54-ca32-4dc8-8ccb-1834ca9e395b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:49.303659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e6c9a-c44b-4939-9cf6-872fe7e3cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:49.304355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e6c9a-c44b-4939-9cf6-872fe7e3cd43 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:49.304748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e6c9a-c44b-4939-9cf6-872fe7e3cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:49.304978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e6c9a-c44b-4939-9cf6-872fe7e3cd43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:49.305753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e6c9a-c44b-4939-9cf6-872fe7e3cd43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:49.306054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e6c9a-c44b-4939-9cf6-872fe7e3cd43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:49.320285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 895/1768] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:49 2022] PUT /identity/v3/projects/882815b26bfb445fb56a3be385dcd568/users/14b469d0a518457ab2ddb1d9595c1bab/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:49.329465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e6c9a-c44b-4939-9cf6-872fe7e3cd43 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:49.337961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5316d9-a401-43ad-abd7-db0b2fe76de1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:49.338693 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5316d9-a401-43ad-abd7-db0b2fe76de1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:49.339421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5316d9-a401-43ad-abd7-db0b2fe76de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:49.375435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 874/1769] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:49.379464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e6c9a-c44b-4939-9cf6-872fe7e3cd43 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:49.399558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e6c9a-c44b-4939-9cf6-872fe7e3cd43 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:49.406966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6a5316d9-a401-43ad-abd7-db0b2fe76de1 None None] MFA Rules not processed for user `14b469d0a518457ab2ddb1d9595c1bab`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:49.408650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6a5316d9-a401-43ad-abd7-db0b2fe76de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:49.594430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 896/1770] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:49.621373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5316d9-a401-43ad-abd7-db0b2fe76de1 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:49.628228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6a5316d9-a401-43ad-abd7-db0b2fe76de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:49.632192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043e606-be46-4122-b811-071d22a0250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:49.632919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043e606-be46-4122-b811-071d22a0250b admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:49.633205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043e606-be46-4122-b811-071d22a0250b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:49.633486 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043e606-be46-4122-b811-071d22a0250b admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:49.634194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043e606-be46-4122-b811-071d22a0250b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:49.638962 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043e606-be46-4122-b811-071d22a0250b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:49.713389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 875/1771] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:49 2022] POST /identity/v3/projects => generated 379 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:49.714479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043e606-be46-4122-b811-071d22a0250b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:49.755197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:49.818677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:49.875081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043e606-be46-4122-b811-071d22a0250b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:49.888910 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5316d9-a401-43ad-abd7-db0b2fe76de1 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:49.889577 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ddba7-2dce-4dd2-8fb6-1e96e938f4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:49.892698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ddba7-2dce-4dd2-8fb6-1e96e938f4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:49.895642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ddba7-2dce-4dd2-8fb6-1e96e938f4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:49.897253 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ddba7-2dce-4dd2-8fb6-1e96e938f4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:49.899532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ddba7-2dce-4dd2-8fb6-1e96e938f4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:49.908661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ddba7-2dce-4dd2-8fb6-1e96e938f4f8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:49.977281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 876/1772] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:49 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:49.978558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ddba7-2dce-4dd2-8fb6-1e96e938f4f8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:50.017275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ddba7-2dce-4dd2-8fb6-1e96e938f4f8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:50.047325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1c90-ff08-4b46-9a51-b4e4a3535c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:50.048161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1c90-ff08-4b46-9a51-b4e4a3535c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:50.048454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1c90-ff08-4b46-9a51-b4e4a3535c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:50.048768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1c90-ff08-4b46-9a51-b4e4a3535c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:50.049538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a1c90-ff08-4b46-9a51-b4e4a3535c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:50.051221 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a1c90-ff08-4b46-9a51-b4e4a3535c9f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:50.097653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22de04c-d100-4c2a-865f-05774bd7a3cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:50.102401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de04c-d100-4c2a-865f-05774bd7a3cb service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:50.108084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de04c-d100-4c2a-865f-05774bd7a3cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:50.108591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de04c-d100-4c2a-865f-05774bd7a3cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:50.117402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 877/1773] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:50.126671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1c90-ff08-4b46-9a51-b4e4a3535c9f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:50.160953 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1c90-ff08-4b46-9a51-b4e4a3535c9f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:50.182692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5757af-bba3-4987-9065-4877e1bcdd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:50.185269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5757af-bba3-4987-9065-4877e1bcdd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:50.186695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5757af-bba3-4987-9065-4877e1bcdd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:50.187774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5757af-bba3-4987-9065-4877e1bcdd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:50.188713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5757af-bba3-4987-9065-4877e1bcdd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:50.192734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5757af-bba3-4987-9065-4877e1bcdd50 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:50.228268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 878/1774] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:50.230951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5757af-bba3-4987-9065-4877e1bcdd50 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:50.250058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5757af-bba3-4987-9065-4877e1bcdd50 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:50.262335 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ccd82-29f3-43dc-9d0c-7235d810a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:50.263302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ccd82-29f3-43dc-9d0c-7235d810a98e admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:50.263623 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ccd82-29f3-43dc-9d0c-7235d810a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:50.263906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ccd82-29f3-43dc-9d0c-7235d810a98e admin admin] PATH_INFO: `/v3/projects/2d79d21bae9a48458c94b35d907897d0/users/df76438ebd0f417fa0fc00e1f5fe16a6/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:50.281221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22de04c-d100-4c2a-865f-05774bd7a3cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:50.283100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22de04c-d100-4c2a-865f-05774bd7a3cb service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:50.300242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ccd82-29f3-43dc-9d0c-7235d810a98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d79d21bae9a48458c94b35d907897d0, user_id=df76438ebd0f417fa0fc00e1f5fe16a6, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:50.308384 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 897/1775] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:50.308906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ccd82-29f3-43dc-9d0c-7235d810a98e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:50.340747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 879/1776] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:50 2022] PUT /identity/v3/projects/2d79d21bae9a48458c94b35d907897d0/users/df76438ebd0f417fa0fc00e1f5fe16a6/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:50.352837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b695ddc-75b1-4616-a971-bbef102e5812 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:50.353584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b695ddc-75b1-4616-a971-bbef102e5812 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:50.354197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b695ddc-75b1-4616-a971-bbef102e5812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:50.432355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8b695ddc-75b1-4616-a971-bbef102e5812 None None] MFA Rules not processed for user `df76438ebd0f417fa0fc00e1f5fe16a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:50.435607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8b695ddc-75b1-4616-a971-bbef102e5812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:50.664422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 898/1777] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:50.668820 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ccd82-29f3-43dc-9d0c-7235d810a98e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:50.964670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ccd82-29f3-43dc-9d0c-7235d810a98e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:50.993790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99793f74-6255-4f3d-9101-2b9a054715b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:50.998589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793f74-6255-4f3d-9101-2b9a054715b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:50.998891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793f74-6255-4f3d-9101-2b9a054715b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:50.999187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99793f74-6255-4f3d-9101-2b9a054715b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:51.000117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99793f74-6255-4f3d-9101-2b9a054715b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:51.005271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99793f74-6255-4f3d-9101-2b9a054715b3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:51.103414 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 880/1778] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:50 2022] POST /identity/v3/projects => generated 377 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:51.107629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b695ddc-75b1-4616-a971-bbef102e5812 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:51.141852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b695ddc-75b1-4616-a971-bbef102e5812 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:51.259963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:51.414236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0edb0-97e3-43dc-88ae-9b933033ed41 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:51.414726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0edb0-97e3-43dc-88ae-9b933033ed41 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:51.415239 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0edb0-97e3-43dc-88ae-9b933033ed41 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:51.419266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 881/1779] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:13:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:13:51.446920 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79f3da-3d39-409d-be90-34bf825385b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:51.454825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79f3da-3d39-409d-be90-34bf825385b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:51.456435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79f3da-3d39-409d-be90-34bf825385b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:51.457868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79f3da-3d39-409d-be90-34bf825385b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:51.459593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79f3da-3d39-409d-be90-34bf825385b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:51.465560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79f3da-3d39-409d-be90-34bf825385b8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:51.519852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 899/1780] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:51 2022] POST /identity/v3/users => generated 289 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:51.528027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0edb0-97e3-43dc-88ae-9b933033ed41 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:51.559743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0edb0-97e3-43dc-88ae-9b933033ed41 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:51.566746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b59acb-e219-46c7-b09b-44b6974f1e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:51.567863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b59acb-e219-46c7-b09b-44b6974f1e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:51.568963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b59acb-e219-46c7-b09b-44b6974f1e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:51.569423 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b59acb-e219-46c7-b09b-44b6974f1e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:51.573474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b59acb-e219-46c7-b09b-44b6974f1e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:51.575593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b59acb-e219-46c7-b09b-44b6974f1e6c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:51.608047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 882/1781] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:51.613991 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79f3da-3d39-409d-be90-34bf825385b8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:51.650445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79f3da-3d39-409d-be90-34bf825385b8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:51.657652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b18db-9677-40bb-b73a-eb4fdac811f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:51.658913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b18db-9677-40bb-b73a-eb4fdac811f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:51.659551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b18db-9677-40bb-b73a-eb4fdac811f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:51.660099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b18db-9677-40bb-b73a-eb4fdac811f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:51.661600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b18db-9677-40bb-b73a-eb4fdac811f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:51.665576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b18db-9677-40bb-b73a-eb4fdac811f7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:51.716346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 900/1782] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:51.720742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b59acb-e219-46c7-b09b-44b6974f1e6c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:51.753003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b59acb-e219-46c7-b09b-44b6974f1e6c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:51.770700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea906dea-57c6-47a2-a67f-3385fae7cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:51.777999 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea906dea-57c6-47a2-a67f-3385fae7cab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:51.778466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea906dea-57c6-47a2-a67f-3385fae7cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:51.783497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa749e-cffd-4454-a5bc-f1c7b8e13158 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:51.784245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa749e-cffd-4454-a5bc-f1c7b8e13158 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:51.784529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa749e-cffd-4454-a5bc-f1c7b8e13158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:51.791141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea906dea-57c6-47a2-a67f-3385fae7cab6 admin admin] PATH_INFO: `/v3/projects/531c9e4d247b492693a0681a69cfc3b7/users/02229d2bb4814593b994b174a656f1c6/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:51.851755 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-35aa749e-cffd-4454-a5bc-f1c7b8e13158 None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:51.855615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-35aa749e-cffd-4454-a5bc-f1c7b8e13158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:51.864647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea906dea-57c6-47a2-a67f-3385fae7cab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531c9e4d247b492693a0681a69cfc3b7, user_id=02229d2bb4814593b994b174a656f1c6, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:51.875054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea906dea-57c6-47a2-a67f-3385fae7cab6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:51.915029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 883/1783] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:51 2022] PUT /identity/v3/projects/531c9e4d247b492693a0681a69cfc3b7/users/02229d2bb4814593b994b174a656f1c6/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:51.931732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301ccec-fbaa-4458-a64b-70f2c22205ef None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:51.932301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301ccec-fbaa-4458-a64b-70f2c22205ef None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:51.932729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301ccec-fbaa-4458-a64b-70f2c22205ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:52.034289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:52.042210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e301ccec-fbaa-4458-a64b-70f2c22205ef None None] MFA Rules not processed for user `02229d2bb4814593b994b174a656f1c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:52.045903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e301ccec-fbaa-4458-a64b-70f2c22205ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:52.048359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 901/1784] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:13:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:52.049356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa749e-cffd-4454-a5bc-f1c7b8e13158 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:52.086623 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa749e-cffd-4454-a5bc-f1c7b8e13158 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:52.277482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6211f30-cda3-4dcf-9ace-b2680c2643be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:52.281434 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6211f30-cda3-4dcf-9ace-b2680c2643be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:52.281868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6211f30-cda3-4dcf-9ace-b2680c2643be admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:52.285115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6211f30-cda3-4dcf-9ace-b2680c2643be admin admin] PATH_INFO: `/v3/users/9d6f1c5cc5244df98a446ec9c747cb85` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:52.295227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6211f30-cda3-4dcf-9ace-b2680c2643be admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6f1c5cc5244df98a446ec9c747cb85)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:52.309199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6211f30-cda3-4dcf-9ace-b2680c2643be admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:52.411090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:52.432000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d6211f30-cda3-4dcf-9ace-b2680c2643be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6f1c5cc5244df98a446ec9c747cb85'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:52.445616 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d6211f30-cda3-4dcf-9ace-b2680c2643be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6f1c5cc5244df98a446ec9c747cb85'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:52.446376 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d6211f30-cda3-4dcf-9ace-b2680c2643be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6f1c5cc5244df98a446ec9c747cb85'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:52.447129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d6211f30-cda3-4dcf-9ace-b2680c2643be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6f1c5cc5244df98a446ec9c747cb85'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:52.452656 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 884/1785] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:52.460405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c826db1-5c11-402d-825a-58240162b022 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:52.461099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c826db1-5c11-402d-825a-58240162b022 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:52.461697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c826db1-5c11-402d-825a-58240162b022 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:52.463756 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 885/1786] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:13:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:13:52.465108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d6211f30-cda3-4dcf-9ace-b2680c2643be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6f1c5cc5244df98a446ec9c747cb85'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:52.467654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c826db1-5c11-402d-825a-58240162b022 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:52.472374 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5c826db1-5c11-402d-825a-58240162b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:52.514086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 902/1787] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:52 2022] DELETE /identity/v3/users/9d6f1c5cc5244df98a446ec9c747cb85 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:52.518713 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb67ad-96bc-41d9-b700-1524462154f1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:52.519012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb67ad-96bc-41d9-b700-1524462154f1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:52.519325 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb67ad-96bc-41d9-b700-1524462154f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:52.525332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c826db1-5c11-402d-825a-58240162b022 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:52.546264 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-85fb67ad-96bc-41d9-b700-1524462154f1 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:52.547736 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-85fb67ad-96bc-41d9-b700-1524462154f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:52.730743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93efb-8f67-48c1-8911-1ab05425d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:52.730969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93efb-8f67-48c1-8911-1ab05425d965 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:52.732043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 903/1788] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:52.733037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93efb-8f67-48c1-8911-1ab05425d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:52.733329 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93efb-8f67-48c1-8911-1ab05425d965 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:52.734177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e93efb-8f67-48c1-8911-1ab05425d965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:52.736520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e771f84-bffd-4715-8499-2930694d14cf None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:52.736878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e771f84-bffd-4715-8499-2930694d14cf None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:52.737161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e771f84-bffd-4715-8499-2930694d14cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:52.744879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e93efb-8f67-48c1-8911-1ab05425d965 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:52.794947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2e771f84-bffd-4715-8499-2930694d14cf None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:52.796182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2e771f84-bffd-4715-8499-2930694d14cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:52.858213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 886/1789] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:52 2022] POST /identity/v3/projects => generated 377 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:52.860069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93efb-8f67-48c1-8911-1ab05425d965 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:52.980128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 904/1790] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:13:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:53.082798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e771f84-bffd-4715-8499-2930694d14cf None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:53.086296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2e771f84-bffd-4715-8499-2930694d14cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:53.110200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93efb-8f67-48c1-8911-1ab05425d965 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:53.127097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e771f84-bffd-4715-8499-2930694d14cf None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:53.138554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c23cbd-7f18-44dc-905a-53e9f0301264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:53.139461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0421ca3-322e-4694-98a0-908ddf1fe461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:53.139602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c23cbd-7f18-44dc-905a-53e9f0301264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:53.139820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c23cbd-7f18-44dc-905a-53e9f0301264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:53.140015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c23cbd-7f18-44dc-905a-53e9f0301264 admin admin] PATH_INFO: `/v3/users/5fcd8e2432ef469299922ff57963fe83` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:53.141849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0421ca3-322e-4694-98a0-908ddf1fe461 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:53.142166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0421ca3-322e-4694-98a0-908ddf1fe461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:53.142409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c23cbd-7f18-44dc-905a-53e9f0301264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fcd8e2432ef469299922ff57963fe83)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:53.142526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0421ca3-322e-4694-98a0-908ddf1fe461 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:53.143162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0421ca3-322e-4694-98a0-908ddf1fe461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:53.144377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c23cbd-7f18-44dc-905a-53e9f0301264 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:53.151329 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0421ca3-322e-4694-98a0-908ddf1fe461 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:53.239521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 887/1791] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:52 2022] POST /identity/v3/users => generated 295 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:53.244105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0421ca3-322e-4694-98a0-908ddf1fe461 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:53.282300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0421ca3-322e-4694-98a0-908ddf1fe461 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:53.304098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a36c4-632e-491d-8c4f-5e1f1957aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:53.304852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a36c4-632e-491d-8c4f-5e1f1957aca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:53.305143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a36c4-632e-491d-8c4f-5e1f1957aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:53.305422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a36c4-632e-491d-8c4f-5e1f1957aca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:53.306243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a36c4-632e-491d-8c4f-5e1f1957aca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:53.316647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:53.317212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a36c4-632e-491d-8c4f-5e1f1957aca1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:53.317331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a2c23cbd-7f18-44dc-905a-53e9f0301264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fcd8e2432ef469299922ff57963fe83'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:53.350661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 888/1792] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:53.353161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a36c4-632e-491d-8c4f-5e1f1957aca1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:53.357505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a2c23cbd-7f18-44dc-905a-53e9f0301264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fcd8e2432ef469299922ff57963fe83'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:53.360353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a2c23cbd-7f18-44dc-905a-53e9f0301264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fcd8e2432ef469299922ff57963fe83'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:53.361375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a2c23cbd-7f18-44dc-905a-53e9f0301264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fcd8e2432ef469299922ff57963fe83'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:53.382346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a36c4-632e-491d-8c4f-5e1f1957aca1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:53.398740 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a2c23cbd-7f18-44dc-905a-53e9f0301264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fcd8e2432ef469299922ff57963fe83'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:53.399541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c6e83-bd8e-4722-b259-61c745c3c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:53.400518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c6e83-bd8e-4722-b259-61c745c3c379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:53.400826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c6e83-bd8e-4722-b259-61c745c3c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:53.401106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c6e83-bd8e-4722-b259-61c745c3c379 admin admin] PATH_INFO: `/v3/projects/0dfe21d6bcab4fab924b92e78417f8b1/users/553b07f3462b4a71aad82a9d8bc3ae71/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:53.408839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:53.441062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 905/1793] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:53 2022] DELETE /identity/v3/users/5fcd8e2432ef469299922ff57963fe83 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:53.451146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d1efb-1e48-4014-b359-9e2c795eac6c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:53.451482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d1efb-1e48-4014-b359-9e2c795eac6c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:53.452556 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c6e83-bd8e-4722-b259-61c745c3c379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfe21d6bcab4fab924b92e78417f8b1, user_id=553b07f3462b4a71aad82a9d8bc3ae71, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:53.453340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d1efb-1e48-4014-b359-9e2c795eac6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:53.465841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c6e83-bd8e-4722-b259-61c745c3c379 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:53.509852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-416d1efb-1e48-4014-b359-9e2c795eac6c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:53.511091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-416d1efb-1e48-4014-b359-9e2c795eac6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:53.515347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 889/1794] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:53 2022] PUT /identity/v3/projects/0dfe21d6bcab4fab924b92e78417f8b1/users/553b07f3462b4a71aad82a9d8bc3ae71/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:53.524090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c6e83-bd8e-4722-b259-61c745c3c379 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:53.529525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-686c6e83-bd8e-4722-b259-61c745c3c379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:53.697723 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 906/1795] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:53.699479 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d1efb-1e48-4014-b359-9e2c795eac6c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:53.706830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-416d1efb-1e48-4014-b359-9e2c795eac6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:53.726202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c6e83-bd8e-4722-b259-61c745c3c379 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:53.736371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c6a48-e60c-442d-af77-2c81715bd142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:53.737186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c6a48-e60c-442d-af77-2c81715bd142 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:53.737471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c6a48-e60c-442d-af77-2c81715bd142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:53.737752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c6a48-e60c-442d-af77-2c81715bd142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:53.738535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c6a48-e60c-442d-af77-2c81715bd142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:53.744121 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c6a48-e60c-442d-af77-2c81715bd142 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:53.788672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 890/1796] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:53.795234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c6a48-e60c-442d-af77-2c81715bd142 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:53.797384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1f5c6a48-e60c-442d-af77-2c81715bd142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:53.830759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c6a48-e60c-442d-af77-2c81715bd142 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:53.845541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:53.848224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:53.848513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:53.850906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] PATH_INFO: `/v3/users/50ce196df3a04bf6acd18f4cffbd6516` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:53.852529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ce196df3a04bf6acd18f4cffbd6516)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:53.857835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:53.873682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d1efb-1e48-4014-b359-9e2c795eac6c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:53.888090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128c624-97b9-4b7f-92a9-56086934e808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:53.888952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c624-97b9-4b7f-92a9-56086934e808 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:53.889236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c624-97b9-4b7f-92a9-56086934e808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:53.889573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c624-97b9-4b7f-92a9-56086934e808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:53.893159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f128c624-97b9-4b7f-92a9-56086934e808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:53.948684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128c624-97b9-4b7f-92a9-56086934e808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:53.957215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128c624-97b9-4b7f-92a9-56086934e808 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:53.986111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 907/1797] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:53.987781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128c624-97b9-4b7f-92a9-56086934e808 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:53.989076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ce196df3a04bf6acd18f4cffbd6516'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:53.993715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f128c624-97b9-4b7f-92a9-56086934e808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:54.008465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ce196df3a04bf6acd18f4cffbd6516'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:54.010338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ce196df3a04bf6acd18f4cffbd6516'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:54.011347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ce196df3a04bf6acd18f4cffbd6516'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:54.016656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128c624-97b9-4b7f-92a9-56086934e808 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:54.033026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ce196df3a04bf6acd18f4cffbd6516'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:54.040755 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7a243-0cbe-45db-b2ba-bb1d0a635031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:54.041691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7a243-0cbe-45db-b2ba-bb1d0a635031 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:54.042170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7a243-0cbe-45db-b2ba-bb1d0a635031 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:54.042624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7a243-0cbe-45db-b2ba-bb1d0a635031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:54.045514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8ee7a243-0cbe-45db-b2ba-bb1d0a635031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:54.072948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7a243-0cbe-45db-b2ba-bb1d0a635031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:54.078144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7a243-0cbe-45db-b2ba-bb1d0a635031 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:54.078866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 891/1798] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:53 2022] DELETE /identity/v3/users/50ce196df3a04bf6acd18f4cffbd6516 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:54.080844 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:54.085622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:54.101996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 908/1799] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:54.103861 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7a243-0cbe-45db-b2ba-bb1d0a635031 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:54.108223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8ee7a243-0cbe-45db-b2ba-bb1d0a635031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:54.226103 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:54.239849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:54.269125 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1f9e3-2139-4ea6-9d6a-56f46235b1ee admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:54.277111 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c27f21-1fc8-4305-b9fd-b0541e372cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:54.278171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27f21-1fc8-4305-b9fd-b0541e372cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:54.278513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27f21-1fc8-4305-b9fd-b0541e372cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:54.278799 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c27f21-1fc8-4305-b9fd-b0541e372cf9 admin admin] PATH_INFO: `/v3/projects/0dfe21d6bcab4fab924b92e78417f8b1/users/553b07f3462b4a71aad82a9d8bc3ae71/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:54.297551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7a243-0cbe-45db-b2ba-bb1d0a635031 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:54.305106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c27f21-1fc8-4305-b9fd-b0541e372cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfe21d6bcab4fab924b92e78417f8b1, user_id=553b07f3462b4a71aad82a9d8bc3ae71, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:54.319064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c27f21-1fc8-4305-b9fd-b0541e372cf9 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:54.356798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 892/1800] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:54 2022] PUT /identity/v3/projects/0dfe21d6bcab4fab924b92e78417f8b1/users/553b07f3462b4a71aad82a9d8bc3ae71/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:54.357955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c27f21-1fc8-4305-b9fd-b0541e372cf9 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:54.368219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f5c27f21-1fc8-4305-b9fd-b0541e372cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:54.508958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c30e6-f827-4a0b-9f91-e2fbc5a66346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:54.509998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c30e6-f827-4a0b-9f91-e2fbc5a66346 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:54.510330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c30e6-f827-4a0b-9f91-e2fbc5a66346 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:54.512434 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c30e6-f827-4a0b-9f91-e2fbc5a66346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:54.517670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5e2c30e6-f827-4a0b-9f91-e2fbc5a66346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:54.552196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c30e6-f827-4a0b-9f91-e2fbc5a66346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:54.556596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c30e6-f827-4a0b-9f91-e2fbc5a66346 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:54.609059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c27f21-1fc8-4305-b9fd-b0541e372cf9 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:54.613450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 909/1801] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:54.617412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaa79c-d8eb-44cd-a3ef-1c12f6e779ce None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:54.617741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaa79c-d8eb-44cd-a3ef-1c12f6e779ce None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:54.621958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaa79c-d8eb-44cd-a3ef-1c12f6e779ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:54.644481 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00652bf4-e135-4149-9555-eeb2d4c73438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:54.646123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652bf4-e135-4149-9555-eeb2d4c73438 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:54.646539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652bf4-e135-4149-9555-eeb2d4c73438 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:54.646880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652bf4-e135-4149-9555-eeb2d4c73438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:54.653808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-00652bf4-e135-4149-9555-eeb2d4c73438 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:54.681254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8eaaa79c-d8eb-44cd-a3ef-1c12f6e779ce None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:54.682888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8eaaa79c-d8eb-44cd-a3ef-1c12f6e779ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:54.687476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00652bf4-e135-4149-9555-eeb2d4c73438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:54.689977 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00652bf4-e135-4149-9555-eeb2d4c73438 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:54.736596 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 893/1802] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:54.742121 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242ad2-e154-4d4a-8bb4-210ae6632694 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:54.742359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242ad2-e154-4d4a-8bb4-210ae6632694 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:54.742643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242ad2-e154-4d4a-8bb4-210ae6632694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:54.804323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c2242ad2-e154-4d4a-8bb4-210ae6632694 None None] MFA Rules not processed for user `553b07f3462b4a71aad82a9d8bc3ae71`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:54.805605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c2242ad2-e154-4d4a-8bb4-210ae6632694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:54.884858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 910/1803] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:54.936661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaa79c-d8eb-44cd-a3ef-1c12f6e779ce None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:54.938108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8eaaa79c-d8eb-44cd-a3ef-1c12f6e779ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:55.006838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 894/1804] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:55.028927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2242ad2-e154-4d4a-8bb4-210ae6632694 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:55.030891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c2242ad2-e154-4d4a-8bb4-210ae6632694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:55.035940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaa79c-d8eb-44cd-a3ef-1c12f6e779ce None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:55.050511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e20b8-b3ba-49c5-bd2f-0cfb40a50412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:55.051597 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e20b8-b3ba-49c5-bd2f-0cfb40a50412 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:55.053487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e20b8-b3ba-49c5-bd2f-0cfb40a50412 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:55.054492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e20b8-b3ba-49c5-bd2f-0cfb40a50412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:55.094951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e20b8-b3ba-49c5-bd2f-0cfb40a50412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:55.097754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e20b8-b3ba-49c5-bd2f-0cfb40a50412 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:55.114444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 911/1805] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:55.173072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2242ad2-e154-4d4a-8bb4-210ae6632694 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:55.181152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad90a3d-d826-4bdd-a296-32eef67af8b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:55.182041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90a3d-d826-4bdd-a296-32eef67af8b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:55.182527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90a3d-d826-4bdd-a296-32eef67af8b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:55.183273 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90a3d-d826-4bdd-a296-32eef67af8b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:55.184701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e20b8-b3ba-49c5-bd2f-0cfb40a50412 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:55.186228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bd8e20b8-b3ba-49c5-bd2f-0cfb40a50412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:55.208033 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e20b8-b3ba-49c5-bd2f-0cfb40a50412 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:55.211125 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad90a3d-d826-4bdd-a296-32eef67af8b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:55.218372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad90a3d-d826-4bdd-a296-32eef67af8b0 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:55.219643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:55.223080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:55.223781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:55.223781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] PATH_INFO: `/v3/projects/17785e7615eb4d3e8886f5373409f6a2` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:55.225017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:55.228064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] RBAC: Authorizing `identity:delete_project(project_id=17785e7615eb4d3e8886f5373409f6a2)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:55.233364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:55.238470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 895/1806] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:55.261716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:55.288128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad90a3d-d826-4bdd-a296-32eef67af8b0 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:55.291212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-aad90a3d-d826-4bdd-a296-32eef67af8b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:55.310796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad90a3d-d826-4bdd-a296-32eef67af8b0 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:55.326427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17785e7615eb4d3e8886f5373409f6a2', 'request_id': 'req-37775238-6858-4f4d-b5f6-caf567a3c44e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.337624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17785e7615eb4d3e8886f5373409f6a2', 'request_id': 'req-37775238-6858-4f4d-b5f6-caf567a3c44e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.346847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17785e7615eb4d3e8886f5373409f6a2', 'request_id': 'req-37775238-6858-4f4d-b5f6-caf567a3c44e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.368746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] The token cache is being invalidate because project 17785e7615eb4d3e8886f5373409f6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:55.369116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.370700 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.375919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 912/1807] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:55 2022] DELETE /identity/v3/projects/17785e7615eb4d3e8886f5373409f6a2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:55.376779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:55.378413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:55.398585 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b19a2-cc10-439f-bdc6-73859ab6de84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:55.399495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b19a2-cc10-439f-bdc6-73859ab6de84 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:55.399887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b19a2-cc10-439f-bdc6-73859ab6de84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:55.400326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b19a2-cc10-439f-bdc6-73859ab6de84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:55.403281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ff9b19a2-cc10-439f-bdc6-73859ab6de84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:55.462458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37775238-6858-4f4d-b5f6-caf567a3c44e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:55.471770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:55.472831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:55.473118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:55.473395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] PATH_INFO: `/v3/users/14b469d0a518457ab2ddb1d9595c1bab` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:55.476527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b469d0a518457ab2ddb1d9595c1bab)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:55.478707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:55.493897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b19a2-cc10-439f-bdc6-73859ab6de84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:55.495777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b19a2-cc10-439f-bdc6-73859ab6de84 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:55.507383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 896/1808] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:55.546610 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b469d0a518457ab2ddb1d9595c1bab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.554580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b469d0a518457ab2ddb1d9595c1bab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.555306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b469d0a518457ab2ddb1d9595c1bab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.556487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b469d0a518457ab2ddb1d9595c1bab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.579102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b469d0a518457ab2ddb1d9595c1bab'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.595501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 913/1809] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:55 2022] DELETE /identity/v3/users/14b469d0a518457ab2ddb1d9595c1bab => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:55.671711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b19a2-cc10-439f-bdc6-73859ab6de84 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:55.674237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ff9b19a2-cc10-439f-bdc6-73859ab6de84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:55.706473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b19a2-cc10-439f-bdc6-73859ab6de84 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:55.781705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:55.782721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:55.783313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:55.783443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] PATH_INFO: `/v3/projects/3e4470f91cc8421a822ff9bcafed1593` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:55.784967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4470f91cc8421a822ff9bcafed1593)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:55.787943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:55.847974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4470f91cc8421a822ff9bcafed1593', 'request_id': 'req-b493fe1b-72e8-43d8-a8c8-0376735925f8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.863657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4470f91cc8421a822ff9bcafed1593', 'request_id': 'req-b493fe1b-72e8-43d8-a8c8-0376735925f8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.866025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:55.877672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:55.877672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:55.887160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4470f91cc8421a822ff9bcafed1593', 'request_id': 'req-b493fe1b-72e8-43d8-a8c8-0376735925f8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.898106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e73d5-dca9-4093-8070-80f32b0c9de1 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:55.930620 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:55.932171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] The token cache is being invalidate because project 3e4470f91cc8421a822ff9bcafed1593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:55.932728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.934158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:55.937784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 897/1810] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:55 2022] DELETE /identity/v3/projects/3e4470f91cc8421a822ff9bcafed1593 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:55.950738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:55.953046 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:56.011348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:56.012663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.013125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.013646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] PATH_INFO: `/v3/projects/cfbf0fe03dc24623a382a828da467bc5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:56.016065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfbf0fe03dc24623a382a828da467bc5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:56.019526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:56.046958 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493fe1b-72e8-43d8-a8c8-0376735925f8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:56.053087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:56.054345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.054745 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.055104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] PATH_INFO: `/v3/users/87601ad66b154fe2842d8afeebf5ce44` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:56.056528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] RBAC: Authorizing `identity:delete_user(user_id=87601ad66b154fe2842d8afeebf5ce44)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:56.058636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:56.091480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfbf0fe03dc24623a382a828da467bc5', 'request_id': 'req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.101574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfbf0fe03dc24623a382a828da467bc5', 'request_id': 'req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.111707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfbf0fe03dc24623a382a828da467bc5', 'request_id': 'req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.117576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87601ad66b154fe2842d8afeebf5ce44'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.125409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] The token cache is being invalidate because project cfbf0fe03dc24623a382a828da467bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:56.125794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.126306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87601ad66b154fe2842d8afeebf5ce44'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.126521 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.127021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87601ad66b154fe2842d8afeebf5ce44'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.127723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87601ad66b154fe2842d8afeebf5ce44'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.128138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 914/1811] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:55 2022] DELETE /identity/v3/projects/cfbf0fe03dc24623a382a828da467bc5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:56.128939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:56.130233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:56.144187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87601ad66b154fe2842d8afeebf5ce44'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.158383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 898/1812] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:55 2022] DELETE /identity/v3/users/87601ad66b154fe2842d8afeebf5ce44 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:56.159311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:56.161012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:56.231642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ccc7d-75c0-4e7e-bd65-4094302e4be7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:56.241889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b473ff-b83e-4d42-af27-dc0d8262031b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:56.245076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:56.246357 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.248441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccd5aa-5933-4f09-9ec2-6624470a481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:56.248941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.249329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] PATH_INFO: `/v3/projects/882815b26bfb445fb56a3be385dcd568` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:56.250001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccd5aa-5933-4f09-9ec2-6624470a481e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.250489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccd5aa-5933-4f09-9ec2-6624470a481e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.251696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccd5aa-5933-4f09-9ec2-6624470a481e admin admin] PATH_INFO: `/v3/users/5c422848d43949cba31f40bc07ad7006` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:56.252165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882815b26bfb445fb56a3be385dcd568)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:56.253576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccd5aa-5933-4f09-9ec2-6624470a481e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c422848d43949cba31f40bc07ad7006)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:56.256815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccd5aa-5933-4f09-9ec2-6624470a481e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:56.257194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:56.260922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:56.316457 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9eccd5aa-5933-4f09-9ec2-6624470a481e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c422848d43949cba31f40bc07ad7006'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.338466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9eccd5aa-5933-4f09-9ec2-6624470a481e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c422848d43949cba31f40bc07ad7006'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.339167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9eccd5aa-5933-4f09-9ec2-6624470a481e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c422848d43949cba31f40bc07ad7006'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.339802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9eccd5aa-5933-4f09-9ec2-6624470a481e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c422848d43949cba31f40bc07ad7006'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.355786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9eccd5aa-5933-4f09-9ec2-6624470a481e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c422848d43949cba31f40bc07ad7006'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.366393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882815b26bfb445fb56a3be385dcd568', 'request_id': 'req-d629b083-6e0a-411b-92c3-d7d172741d85'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.378155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882815b26bfb445fb56a3be385dcd568', 'request_id': 'req-d629b083-6e0a-411b-92c3-d7d172741d85'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.381340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:56.386172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 899/1813] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:56 2022] DELETE /identity/v3/users/5c422848d43949cba31f40bc07ad7006 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:56.393262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882815b26bfb445fb56a3be385dcd568', 'request_id': 'req-d629b083-6e0a-411b-92c3-d7d172741d85'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.408845 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] The token cache is being invalidate because project 882815b26bfb445fb56a3be385dcd568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:56.409575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.410880 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d629b083-6e0a-411b-92c3-d7d172741d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:56.413769 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 915/1814] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:56 2022] DELETE /identity/v3/projects/882815b26bfb445fb56a3be385dcd568 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:56.418617 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4bc83-5710-4e0a-98b5-efcfa5269b07 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.419113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4bc83-5710-4e0a-98b5-efcfa5269b07 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.419411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4bc83-5710-4e0a-98b5-efcfa5269b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:56.445979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-46d4bc83-5710-4e0a-98b5-efcfa5269b07 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:56.447335 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-46d4bc83-5710-4e0a-98b5-efcfa5269b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:56.533348 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea53d3a-4391-4664-977d-3e7fedad308b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.533639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea53d3a-4391-4664-977d-3e7fedad308b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.534148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea53d3a-4391-4664-977d-3e7fedad308b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:56.546641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 900/1815] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:56.563438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-cea53d3a-4391-4664-977d-3e7fedad308b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:56.565129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-cea53d3a-4391-4664-977d-3e7fedad308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:56.578149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 916/1816] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:56.583126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4bc83-5710-4e0a-98b5-efcfa5269b07 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:56.594990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4bc83-5710-4e0a-98b5-efcfa5269b07 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:56.600646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a8df-822a-41cc-bfe6-165cd0290363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:56.601298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a8df-822a-41cc-bfe6-165cd0290363 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.601591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a8df-822a-41cc-bfe6-165cd0290363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.602242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a8df-822a-41cc-bfe6-165cd0290363 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:56.603426 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7a8df-822a-41cc-bfe6-165cd0290363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:56.603426 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7a8df-822a-41cc-bfe6-165cd0290363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:56.605082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7a8df-822a-41cc-bfe6-165cd0290363 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:56.622631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 901/1817] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:56.632411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea53d3a-4391-4664-977d-3e7fedad308b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:56.647425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea53d3a-4391-4664-977d-3e7fedad308b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:56.653630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29882e8-eddf-4d72-b6fb-a9d534aba07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:56.654306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29882e8-eddf-4d72-b6fb-a9d534aba07c admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.654588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29882e8-eddf-4d72-b6fb-a9d534aba07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.654869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29882e8-eddf-4d72-b6fb-a9d534aba07c admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:56.655563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29882e8-eddf-4d72-b6fb-a9d534aba07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:56.657698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29882e8-eddf-4d72-b6fb-a9d534aba07c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:56.697681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 917/1818] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:56 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:56.701532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a8df-822a-41cc-bfe6-165cd0290363 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:56.714593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a8df-822a-41cc-bfe6-165cd0290363 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:56.815146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7db7f3-1624-4753-be68-5398a9a027f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:56.815341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7db7f3-1624-4753-be68-5398a9a027f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.815514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7db7f3-1624-4753-be68-5398a9a027f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.815778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7db7f3-1624-4753-be68-5398a9a027f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:56.816988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7db7f3-1624-4753-be68-5398a9a027f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:56.818960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7db7f3-1624-4753-be68-5398a9a027f9 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:56.839380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:56.853000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 902/1819] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:56 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:56.857760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29882e8-eddf-4d72-b6fb-a9d534aba07c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:56.869613 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29882e8-eddf-4d72-b6fb-a9d534aba07c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:56.875199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d81f3-d5db-4bc7-8bd8-19cf543d12d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:56.877591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d81f3-d5db-4bc7-8bd8-19cf543d12d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.891052 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d81f3-d5db-4bc7-8bd8-19cf543d12d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.891052 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d81f3-d5db-4bc7-8bd8-19cf543d12d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:56.891749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d81f3-d5db-4bc7-8bd8-19cf543d12d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:56.895221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d81f3-d5db-4bc7-8bd8-19cf543d12d5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:56.916719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 918/1820] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:56.920335 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7db7f3-1624-4753-be68-5398a9a027f9 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:56.933871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7db7f3-1624-4753-be68-5398a9a027f9 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:56.938885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e290be-f424-4574-a1bd-a80475ecea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:56.939776 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e290be-f424-4574-a1bd-a80475ecea98 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.940492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e290be-f424-4574-a1bd-a80475ecea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.940492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e290be-f424-4574-a1bd-a80475ecea98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:56.941375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e290be-f424-4574-a1bd-a80475ecea98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:56.944440 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e290be-f424-4574-a1bd-a80475ecea98 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:56.963210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d81f3-d5db-4bc7-8bd8-19cf543d12d5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:56.971234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 903/1821] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:56.976695 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d81f3-d5db-4bc7-8bd8-19cf543d12d5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:56.982267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a3b48-e83e-4988-ba0a-e428ef7547bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:56.983161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a3b48-e83e-4988-ba0a-e428ef7547bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:56.983444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a3b48-e83e-4988-ba0a-e428ef7547bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:56.983718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a3b48-e83e-4988-ba0a-e428ef7547bf admin admin] PATH_INFO: `/v3/projects/19c2b580af574bf7949544f117042d65/users/7fb674a5d31e48d4997308fa093209e4/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:57.008249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a3b48-e83e-4988-ba0a-e428ef7547bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c2b580af574bf7949544f117042d65, user_id=7fb674a5d31e48d4997308fa093209e4, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:57.011220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a3b48-e83e-4988-ba0a-e428ef7547bf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:57.030998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 919/1822] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:56 2022] PUT /identity/v3/projects/19c2b580af574bf7949544f117042d65/users/7fb674a5d31e48d4997308fa093209e4/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:57.044563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f010310-bd07-4f21-b76d-bbd62f3fffdb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:57.044563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f010310-bd07-4f21-b76d-bbd62f3fffdb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:57.044563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f010310-bd07-4f21-b76d-bbd62f3fffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:57.082442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5f010310-bd07-4f21-b76d-bbd62f3fffdb None None] MFA Rules not processed for user `7fb674a5d31e48d4997308fa093209e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:57.083814 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5f010310-bd07-4f21-b76d-bbd62f3fffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:57.170176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a3b48-e83e-4988-ba0a-e428ef7547bf admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:57.176692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 904/1823] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:57.246260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a3b48-e83e-4988-ba0a-e428ef7547bf admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:57.253046 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086aaa94-1576-4581-8205-f432a095bfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:57.253708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aaa94-1576-4581-8205-f432a095bfdf admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:57.253970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aaa94-1576-4581-8205-f432a095bfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:57.254302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aaa94-1576-4581-8205-f432a095bfdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:57.255251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086aaa94-1576-4581-8205-f432a095bfdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:57.258511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086aaa94-1576-4581-8205-f432a095bfdf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:57.293397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 920/1824] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:57 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:57.301188 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f010310-bd07-4f21-b76d-bbd62f3fffdb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:57.324476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f010310-bd07-4f21-b76d-bbd62f3fffdb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:57.415829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086aaa94-1576-4581-8205-f432a095bfdf admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:57.417657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-086aaa94-1576-4581-8205-f432a095bfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:57.431214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1989af1-b8b6-447c-829f-95c8d485dc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:57.432110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989af1-b8b6-447c-829f-95c8d485dc7e admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:57.432562 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989af1-b8b6-447c-829f-95c8d485dc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:57.433012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1989af1-b8b6-447c-829f-95c8d485dc7e admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:57.433875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1989af1-b8b6-447c-829f-95c8d485dc7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:57.436017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1989af1-b8b6-447c-829f-95c8d485dc7e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:57.460190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 905/1825] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:57 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:57.463925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1989af1-b8b6-447c-829f-95c8d485dc7e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:57.478846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1989af1-b8b6-447c-829f-95c8d485dc7e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:57.485236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73365e90-aa1f-4b54-98c2-b53bf629d2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:57.486008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73365e90-aa1f-4b54-98c2-b53bf629d2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:57.486197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73365e90-aa1f-4b54-98c2-b53bf629d2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:57.486548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73365e90-aa1f-4b54-98c2-b53bf629d2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:57.487204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73365e90-aa1f-4b54-98c2-b53bf629d2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:57.499527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73365e90-aa1f-4b54-98c2-b53bf629d2c0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:57.513286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 906/1826] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:57.518814 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73365e90-aa1f-4b54-98c2-b53bf629d2c0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:57.533110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73365e90-aa1f-4b54-98c2-b53bf629d2c0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:57.557537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851012-0fb8-43f3-b441-23f5646fa0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:57.560161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086aaa94-1576-4581-8205-f432a095bfdf admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:57.561321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851012-0fb8-43f3-b441-23f5646fa0df admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:57.563888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851012-0fb8-43f3-b441-23f5646fa0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:57.563888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851012-0fb8-43f3-b441-23f5646fa0df admin admin] PATH_INFO: `/v3/projects/fa415831d8f6498a85258868dd1ce72c/users/b8a4cca436a6485c9421485df8d1c321/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:57.567019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:57.570002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:57.570272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:57.570845 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] PATH_INFO: `/v3/projects/55d0440aaaf74108b4deb2be744ca422` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:57.572494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d0440aaaf74108b4deb2be744ca422)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:57.575891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:57.585708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:57.605869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9851012-0fb8-43f3-b441-23f5646fa0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa415831d8f6498a85258868dd1ce72c, user_id=b8a4cca436a6485c9421485df8d1c321, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:57.613232 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9851012-0fb8-43f3-b441-23f5646fa0df admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:57.668046 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 907/1827] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:57 2022] PUT /identity/v3/projects/fa415831d8f6498a85258868dd1ce72c/users/b8a4cca436a6485c9421485df8d1c321/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:57.672822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851012-0fb8-43f3-b441-23f5646fa0df admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:57.674947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f9851012-0fb8-43f3-b441-23f5646fa0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:57.704897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d0440aaaf74108b4deb2be744ca422', 'request_id': 'req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:57.715213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d0440aaaf74108b4deb2be744ca422', 'request_id': 'req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:57.729229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:57.733214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d0440aaaf74108b4deb2be744ca422', 'request_id': 'req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:57.757177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] The token cache is being invalidate because project 55d0440aaaf74108b4deb2be744ca422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:57.757618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:57.758484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:57.766483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 921/1828] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:57 2022] DELETE /identity/v3/projects/55d0440aaaf74108b4deb2be744ca422 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:57.769290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:57.771917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:57.794314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851012-0fb8-43f3-b441-23f5646fa0df admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:57.915857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:57.916672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:57.917071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:57.917248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] PATH_INFO: `/v3/projects/3eb29b2d5291464397c72512a65bb59e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:57.918512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb29b2d5291464397c72512a65bb59e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:57.921371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:57.926424 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b026e-c3c1-4d2e-82a9-0f5f1b1b6bfa admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:57.933750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332315cb-aa2a-4005-ba04-c54f0b5428dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:57.934700 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332315cb-aa2a-4005-ba04-c54f0b5428dd admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:57.935188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332315cb-aa2a-4005-ba04-c54f0b5428dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:57.935620 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332315cb-aa2a-4005-ba04-c54f0b5428dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:57.939106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332315cb-aa2a-4005-ba04-c54f0b5428dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:57.941111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332315cb-aa2a-4005-ba04-c54f0b5428dd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:57.959915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 922/1829] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:57.961174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55406668-b74c-4454-a98d-457a064d50a1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:57.961511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55406668-b74c-4454-a98d-457a064d50a1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:57.961796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55406668-b74c-4454-a98d-457a064d50a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:57.985854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-55406668-b74c-4454-a98d-457a064d50a1 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:57.987085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-55406668-b74c-4454-a98d-457a064d50a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:57.989466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb29b2d5291464397c72512a65bb59e', 'request_id': 'req-d73409d8-8b43-4127-8e38-1a2daf820c1b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:57.999863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb29b2d5291464397c72512a65bb59e', 'request_id': 'req-d73409d8-8b43-4127-8e38-1a2daf820c1b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.009935 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb29b2d5291464397c72512a65bb59e', 'request_id': 'req-d73409d8-8b43-4127-8e38-1a2daf820c1b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.033649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] The token cache is being invalidate because project 3eb29b2d5291464397c72512a65bb59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:58.033988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.035563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.038425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 908/1830] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:57 2022] DELETE /identity/v3/projects/3eb29b2d5291464397c72512a65bb59e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:58.039397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.040970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.066514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 923/1831] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:58.068728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4a21e-fd48-4f42-98db-4a8cdbe20860 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.069132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4a21e-fd48-4f42-98db-4a8cdbe20860 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.069515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4a21e-fd48-4f42-98db-4a8cdbe20860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.093671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0fb4a21e-fd48-4f42-98db-4a8cdbe20860 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:58.095090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0fb4a21e-fd48-4f42-98db-4a8cdbe20860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.114216 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 924/1832] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:58.116649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd29dc-6c6a-48ae-8d19-16a34866f252 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.117189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd29dc-6c6a-48ae-8d19-16a34866f252 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.117675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd29dc-6c6a-48ae-8d19-16a34866f252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.161436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-25bd29dc-6c6a-48ae-8d19-16a34866f252 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:58.163246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-25bd29dc-6c6a-48ae-8d19-16a34866f252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.174037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 925/1833] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:58.175880 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292333-bd23-4d49-80ab-6f80446f1df0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.176525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292333-bd23-4d49-80ab-6f80446f1df0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.177110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292333-bd23-4d49-80ab-6f80446f1df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.199942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-46292333-bd23-4d49-80ab-6f80446f1df0 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:58.201201 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-46292333-bd23-4d49-80ab-6f80446f1df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.206686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73409d8-8b43-4127-8e38-1a2daf820c1b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.212424 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 926/1834] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:58.215843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2750143-866e-4633-8da5-b096cb4d6d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.215843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2750143-866e-4633-8da5-b096cb4d6d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.215843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2750143-866e-4633-8da5-b096cb4d6d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.215843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2750143-866e-4633-8da5-b096cb4d6d41 admin admin] PATH_INFO: `/v3/projects/fa415831d8f6498a85258868dd1ce72c/users/b8a4cca436a6485c9421485df8d1c321/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.216588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2750143-866e-4633-8da5-b096cb4d6d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa415831d8f6498a85258868dd1ce72c, user_id=b8a4cca436a6485c9421485df8d1c321, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.219888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2750143-866e-4633-8da5-b096cb4d6d41 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.226521 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46292333-bd23-4d49-80ab-6f80446f1df0 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.236604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 909/1835] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:58 2022] PUT /identity/v3/projects/fa415831d8f6498a85258868dd1ce72c/users/b8a4cca436a6485c9421485df8d1c321/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:58.237624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2750143-866e-4633-8da5-b096cb4d6d41 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.243256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46292333-bd23-4d49-80ab-6f80446f1df0 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.250575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:58.261741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:58.345526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2750143-866e-4633-8da5-b096cb4d6d41 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.348404 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b2e33-b181-4859-a894-53af36b7b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.349433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b2e33-b181-4859-a894-53af36b7b582 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.349433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b2e33-b181-4859-a894-53af36b7b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.350432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b2e33-b181-4859-a894-53af36b7b582 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.350875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b2e33-b181-4859-a894-53af36b7b582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:58.351803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b2e33-b181-4859-a894-53af36b7b582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.351918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee1cfe-eb45-4918-bb4d-697733517ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.352749 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1cfe-eb45-4918-bb4d-697733517ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.353205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1cfe-eb45-4918-bb4d-697733517ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.353518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1cfe-eb45-4918-bb4d-697733517ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.353627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b2e33-b181-4859-a894-53af36b7b582 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.354842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee1cfe-eb45-4918-bb4d-697733517ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:58.354842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee1cfe-eb45-4918-bb4d-697733517ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.356594 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee1cfe-eb45-4918-bb4d-697733517ffc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.369172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 927/1836] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:58.369712 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 910/1837] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:58.373194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee1cfe-eb45-4918-bb4d-697733517ffc admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.373660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03c6b1-420f-421b-a1e6-0bd21b804727 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.373953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03c6b1-420f-421b-a1e6-0bd21b804727 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.374230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03c6b1-420f-421b-a1e6-0bd21b804727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.385525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee1cfe-eb45-4918-bb4d-697733517ffc admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.392063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d95e50-56bb-4038-8a93-dd970f69a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.392761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95e50-56bb-4038-8a93-dd970f69a458 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.393051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95e50-56bb-4038-8a93-dd970f69a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.393491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95e50-56bb-4038-8a93-dd970f69a458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.394192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95e50-56bb-4038-8a93-dd970f69a458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.396189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95e50-56bb-4038-8a93-dd970f69a458 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.401743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ff03c6b1-420f-421b-a1e6-0bd21b804727 None None] MFA Rules not processed for user `b8a4cca436a6485c9421485df8d1c321`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:58.402970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ff03c6b1-420f-421b-a1e6-0bd21b804727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.423081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 911/1838] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:58 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:58.424242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d95e50-56bb-4038-8a93-dd970f69a458 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.476847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 928/1839] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:58.477648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03c6b1-420f-421b-a1e6-0bd21b804727 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.488005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03c6b1-420f-421b-a1e6-0bd21b804727 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.500661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d95e50-56bb-4038-8a93-dd970f69a458 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.505925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173f6b5-b8c1-46da-9182-fc0aba70984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.506760 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173f6b5-b8c1-46da-9182-fc0aba70984a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.507049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173f6b5-b8c1-46da-9182-fc0aba70984a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.507329 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173f6b5-b8c1-46da-9182-fc0aba70984a admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.508021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173f6b5-b8c1-46da-9182-fc0aba70984a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.510070 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173f6b5-b8c1-46da-9182-fc0aba70984a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.537132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 912/1840] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:58 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:58.538163 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173f6b5-b8c1-46da-9182-fc0aba70984a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.539843 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5173f6b5-b8c1-46da-9182-fc0aba70984a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.551358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b220-f7d5-493c-8086-c6139983df33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.551968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b220-f7d5-493c-8086-c6139983df33 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.552407 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b220-f7d5-493c-8086-c6139983df33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.552594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b220-f7d5-493c-8086-c6139983df33 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.553329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6b220-f7d5-493c-8086-c6139983df33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.555248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6b220-f7d5-493c-8086-c6139983df33 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.576146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 929/1841] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:58 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:58.576973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b220-f7d5-493c-8086-c6139983df33 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.590819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b220-f7d5-493c-8086-c6139983df33 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.599651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173f6b5-b8c1-46da-9182-fc0aba70984a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.603395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b46500-2c34-4f1b-9c5a-5fc2f5ab2357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.604038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b46500-2c34-4f1b-9c5a-5fc2f5ab2357 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.604318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b46500-2c34-4f1b-9c5a-5fc2f5ab2357 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.604591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b46500-2c34-4f1b-9c5a-5fc2f5ab2357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.607594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:58.617263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:58.662798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df30c47-67ec-485c-be7a-915dbc7e7ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.663659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df30c47-67ec-485c-be7a-915dbc7e7ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.663949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df30c47-67ec-485c-be7a-915dbc7e7ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.664243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df30c47-67ec-485c-be7a-915dbc7e7ceb admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.665015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df30c47-67ec-485c-be7a-915dbc7e7ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.667006 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df30c47-67ec-485c-be7a-915dbc7e7ceb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.681380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b46500-2c34-4f1b-9c5a-5fc2f5ab2357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.684187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b46500-2c34-4f1b-9c5a-5fc2f5ab2357 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.688665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 930/1842] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:58 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:58.689531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df30c47-67ec-485c-be7a-915dbc7e7ceb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.697848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 913/1843] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:58.698742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b46500-2c34-4f1b-9c5a-5fc2f5ab2357 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.700794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df30c47-67ec-485c-be7a-915dbc7e7ceb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.706156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c4f39-8850-445d-a54f-b7c8d947bb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.707711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c4f39-8850-445d-a54f-b7c8d947bb86 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.708230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c4f39-8850-445d-a54f-b7c8d947bb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.709156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c4f39-8850-445d-a54f-b7c8d947bb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.709993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c4f39-8850-445d-a54f-b7c8d947bb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.713926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c4f39-8850-445d-a54f-b7c8d947bb86 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.714318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b46500-2c34-4f1b-9c5a-5fc2f5ab2357 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.726519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c633-330d-42cc-9e14-f25932180262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.727479 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 931/1844] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:58.727621 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c633-330d-42cc-9e14-f25932180262 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.728030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c633-330d-42cc-9e14-f25932180262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.728315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c633-330d-42cc-9e14-f25932180262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.729195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068c633-330d-42cc-9e14-f25932180262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.730840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068c633-330d-42cc-9e14-f25932180262 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.732000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c4f39-8850-445d-a54f-b7c8d947bb86 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.743714 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 914/1845] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:58.747512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c633-330d-42cc-9e14-f25932180262 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.750609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c4f39-8850-445d-a54f-b7c8d947bb86 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.757806 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31af9c-c1a1-4b8d-9b19-aa6e90bb2984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.758056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c633-330d-42cc-9e14-f25932180262 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.758612 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31af9c-c1a1-4b8d-9b19-aa6e90bb2984 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.758906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31af9c-c1a1-4b8d-9b19-aa6e90bb2984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.759222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31af9c-c1a1-4b8d-9b19-aa6e90bb2984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.759905 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31af9c-c1a1-4b8d-9b19-aa6e90bb2984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.761541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31af9c-c1a1-4b8d-9b19-aa6e90bb2984 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.762939 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395f6ed-cfd7-4782-b4ff-82fb2c4e6116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.763940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f6ed-cfd7-4782-b4ff-82fb2c4e6116 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.763940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f6ed-cfd7-4782-b4ff-82fb2c4e6116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.764185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f6ed-cfd7-4782-b4ff-82fb2c4e6116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.764952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395f6ed-cfd7-4782-b4ff-82fb2c4e6116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.766535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395f6ed-cfd7-4782-b4ff-82fb2c4e6116 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.772844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 932/1846] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:58.773774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31af9c-c1a1-4b8d-9b19-aa6e90bb2984 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.781237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 915/1847] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:58.782083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395f6ed-cfd7-4782-b4ff-82fb2c4e6116 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.783840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a395f6ed-cfd7-4782-b4ff-82fb2c4e6116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.785157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31af9c-c1a1-4b8d-9b19-aa6e90bb2984 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.790066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb65b1-7130-4ae9-8e0c-b10127feb63d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.790733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb65b1-7130-4ae9-8e0c-b10127feb63d service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.791022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb65b1-7130-4ae9-8e0c-b10127feb63d service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.791303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb65b1-7130-4ae9-8e0c-b10127feb63d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.793245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6cdb65b1-7130-4ae9-8e0c-b10127feb63d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.797386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395f6ed-cfd7-4782-b4ff-82fb2c4e6116 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.802196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.803567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.803857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.804136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] PATH_INFO: `/v3/users/df76438ebd0f417fa0fc00e1f5fe16a6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.805363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df76438ebd0f417fa0fc00e1f5fe16a6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.807284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.853379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb65b1-7130-4ae9-8e0c-b10127feb63d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.854605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df76438ebd0f417fa0fc00e1f5fe16a6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.854853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb65b1-7130-4ae9-8e0c-b10127feb63d service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.862574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df76438ebd0f417fa0fc00e1f5fe16a6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.863609 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df76438ebd0f417fa0fc00e1f5fe16a6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.864099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 933/1848] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:58.864483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df76438ebd0f417fa0fc00e1f5fe16a6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.865459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb65b1-7130-4ae9-8e0c-b10127feb63d service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.880054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df76438ebd0f417fa0fc00e1f5fe16a6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.880579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb65b1-7130-4ae9-8e0c-b10127feb63d service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.888183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb4af7-776e-4ac4-ac78-2af91312df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.889280 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb4af7-776e-4ac4-ac78-2af91312df42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.889575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb4af7-776e-4ac4-ac78-2af91312df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.889863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb4af7-776e-4ac4-ac78-2af91312df42 admin admin] PATH_INFO: `/v3/projects/57218bcc412a4aff9c5e902ec71adcd9/users/a917deda8c1d482e86359eb94ee9c773/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.894629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 916/1849] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:58 2022] DELETE /identity/v3/users/df76438ebd0f417fa0fc00e1f5fe16a6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:58.895507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.897806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.916475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb4af7-776e-4ac4-ac78-2af91312df42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57218bcc412a4aff9c5e902ec71adcd9, user_id=a917deda8c1d482e86359eb94ee9c773, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.920634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb4af7-776e-4ac4-ac78-2af91312df42 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.952369 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 934/1850] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:58 2022] PUT /identity/v3/projects/57218bcc412a4aff9c5e902ec71adcd9/users/a917deda8c1d482e86359eb94ee9c773/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:58.952369 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb223f-8d14-4556-9b61-d3e539c08d85 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.952369 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb223f-8d14-4556-9b61-d3e539c08d85 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.952369 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb223f-8d14-4556-9b61-d3e539c08d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.979650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0fdb223f-8d14-4556-9b61-d3e539c08d85 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:58.981327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0fdb223f-8d14-4556-9b61-d3e539c08d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:59.008071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc68c30-e4d5-4b0e-ae04-3746ac8951d2 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.017517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:59.072996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 935/1851] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:59.074764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48006d3f-7703-4dd6-a0f2-240d94643662 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.075075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48006d3f-7703-4dd6-a0f2-240d94643662 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.075475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48006d3f-7703-4dd6-a0f2-240d94643662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.082098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:59.099064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa39262-8bea-4bfe-be25-908e6886c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.100574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa39262-8bea-4bfe-be25-908e6886c924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.100886 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa39262-8bea-4bfe-be25-908e6886c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.101163 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa39262-8bea-4bfe-be25-908e6886c924 admin admin] PATH_INFO: `/v3/projects/00c568f574f7475887ce7ff81db4f0ff/users/646d28b673294d669aeecf38397c32d6/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.108325 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-48006d3f-7703-4dd6-a0f2-240d94643662 None None] MFA Rules not processed for user `a917deda8c1d482e86359eb94ee9c773`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:59.109638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-48006d3f-7703-4dd6-a0f2-240d94643662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:59.123557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa39262-8bea-4bfe-be25-908e6886c924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c568f574f7475887ce7ff81db4f0ff, user_id=646d28b673294d669aeecf38397c32d6, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.126769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa39262-8bea-4bfe-be25-908e6886c924 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.142253 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 917/1852] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:58 2022] PUT /identity/v3/projects/00c568f574f7475887ce7ff81db4f0ff/users/646d28b673294d669aeecf38397c32d6/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:59.143068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa39262-8bea-4bfe-be25-908e6886c924 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.144969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-afa39262-8bea-4bfe-be25-908e6886c924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:59.249143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa39262-8bea-4bfe-be25-908e6886c924 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.254164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ba664-bd16-4bec-aad9-c78821fd07c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.254855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ba664-bd16-4bec-aad9-c78821fd07c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.255113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ba664-bd16-4bec-aad9-c78821fd07c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.255973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ba664-bd16-4bec-aad9-c78821fd07c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.292382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 936/1853] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:59.293513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee03a7-ca6b-42af-b248-42d4a6dbb9b6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.293854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee03a7-ca6b-42af-b248-42d4a6dbb9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.294083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee03a7-ca6b-42af-b248-42d4a6dbb9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.354377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ba664-bd16-4bec-aad9-c78821fd07c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.354833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c0ee03a7-ca6b-42af-b248-42d4a6dbb9b6 None None] MFA Rules not processed for user `646d28b673294d669aeecf38397c32d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:59.356955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ba664-bd16-4bec-aad9-c78821fd07c1 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.357388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c0ee03a7-ca6b-42af-b248-42d4a6dbb9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:59.369890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 918/1854] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:59.370932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ba664-bd16-4bec-aad9-c78821fd07c1 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.373371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0e0ba664-bd16-4bec-aad9-c78821fd07c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:59.388205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ba664-bd16-4bec-aad9-c78821fd07c1 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.395675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd2d7b-6827-40e9-ab45-c236dd53d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.396640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd2d7b-6827-40e9-ab45-c236dd53d18e admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.397072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd2d7b-6827-40e9-ab45-c236dd53d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.397458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd2d7b-6827-40e9-ab45-c236dd53d18e admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.398350 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd2d7b-6827-40e9-ab45-c236dd53d18e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.400957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd2d7b-6827-40e9-ab45-c236dd53d18e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.441586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 919/1855] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:59.443914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd2d7b-6827-40e9-ab45-c236dd53d18e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.470512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:59.542824 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd2d7b-6827-40e9-ab45-c236dd53d18e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.549272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee12afb-a41c-4229-939e-8a9b05bda6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.550103 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12afb-a41c-4229-939e-8a9b05bda6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.550543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12afb-a41c-4229-939e-8a9b05bda6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.550864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12afb-a41c-4229-939e-8a9b05bda6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.551782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee12afb-a41c-4229-939e-8a9b05bda6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.554592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee12afb-a41c-4229-939e-8a9b05bda6b8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.581014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 937/1856] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:59.588285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee03a7-ca6b-42af-b248-42d4a6dbb9b6 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.591424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 920/1857] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:59.592816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee12afb-a41c-4229-939e-8a9b05bda6b8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.604729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee12afb-a41c-4229-939e-8a9b05bda6b8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.615421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9694b-950b-4124-adae-4f08fcc679b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.616523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9694b-950b-4124-adae-4f08fcc679b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.616685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9694b-950b-4124-adae-4f08fcc679b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.617002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9694b-950b-4124-adae-4f08fcc679b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.617806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9694b-950b-4124-adae-4f08fcc679b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.620662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9694b-950b-4124-adae-4f08fcc679b6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.621258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee03a7-ca6b-42af-b248-42d4a6dbb9b6 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.632320 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07437f-5a2d-4881-9654-ac2e0af47461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.633061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07437f-5a2d-4881-9654-ac2e0af47461 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.633346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07437f-5a2d-4881-9654-ac2e0af47461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.633625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07437f-5a2d-4881-9654-ac2e0af47461 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.634330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07437f-5a2d-4881-9654-ac2e0af47461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.639394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 921/1858] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:13:59.641435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07437f-5a2d-4881-9654-ac2e0af47461 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.643676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9694b-950b-4124-adae-4f08fcc679b6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.657525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9694b-950b-4124-adae-4f08fcc679b6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.666168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729eb4-e4e1-4a92-9490-a66f3c6e03a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.667534 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729eb4-e4e1-4a92-9490-a66f3c6e03a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.667833 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729eb4-e4e1-4a92-9490-a66f3c6e03a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.668123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729eb4-e4e1-4a92-9490-a66f3c6e03a6 admin admin] PATH_INFO: `/v3/projects/61723e9e70f642ac9b6cd8a6a2c67cb9/users/006afc3076bd4cfc99c722e54c687dc8/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.682498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 938/1859] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:59.686174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59729eb4-e4e1-4a92-9490-a66f3c6e03a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61723e9e70f642ac9b6cd8a6a2c67cb9, user_id=006afc3076bd4cfc99c722e54c687dc8, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.686590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07437f-5a2d-4881-9654-ac2e0af47461 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.690142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59729eb4-e4e1-4a92-9490-a66f3c6e03a6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.706554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 922/1860] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:59 2022] PUT /identity/v3/projects/61723e9e70f642ac9b6cd8a6a2c67cb9/users/006afc3076bd4cfc99c722e54c687dc8/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:59.710654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729eb4-e4e1-4a92-9490-a66f3c6e03a6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.768391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07437f-5a2d-4881-9654-ac2e0af47461 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.778093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:59.789481 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729eb4-e4e1-4a92-9490-a66f3c6e03a6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.794288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771df7d0-daab-47cb-bbb1-9fe7f8b8d57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.794961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771df7d0-daab-47cb-bbb1-9fe7f8b8d57b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.795251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771df7d0-daab-47cb-bbb1-9fe7f8b8d57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.795530 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771df7d0-daab-47cb-bbb1-9fe7f8b8d57b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.796266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771df7d0-daab-47cb-bbb1-9fe7f8b8d57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.797912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771df7d0-daab-47cb-bbb1-9fe7f8b8d57b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.808663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 923/1861] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:13:59.809381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771df7d0-daab-47cb-bbb1-9fe7f8b8d57b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.811957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-771df7d0-daab-47cb-bbb1-9fe7f8b8d57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:59.826003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771df7d0-daab-47cb-bbb1-9fe7f8b8d57b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.831008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.831946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.832180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.832463 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] PATH_INFO: `/v3/projects/2d79d21bae9a48458c94b35d907897d0` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.834232 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d79d21bae9a48458c94b35d907897d0)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.836244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.837631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ecab2-d48d-4682-ae5a-46a2ab8f666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.838305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ecab2-d48d-4682-ae5a-46a2ab8f666b admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.838629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ecab2-d48d-4682-ae5a-46a2ab8f666b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.838949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ecab2-d48d-4682-ae5a-46a2ab8f666b admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.839640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ecab2-d48d-4682-ae5a-46a2ab8f666b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.841614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ecab2-d48d-4682-ae5a-46a2ab8f666b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.862245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 939/1862] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:59.863035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ecab2-d48d-4682-ae5a-46a2ab8f666b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.872963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ecab2-d48d-4682-ae5a-46a2ab8f666b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.877777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda693b-151e-43fd-81ab-fad27e53df7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.878660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda693b-151e-43fd-81ab-fad27e53df7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.878943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda693b-151e-43fd-81ab-fad27e53df7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.879222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda693b-151e-43fd-81ab-fad27e53df7f admin admin] PATH_INFO: `/v3/projects/61723e9e70f642ac9b6cd8a6a2c67cb9/users/006afc3076bd4cfc99c722e54c687dc8/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.881271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda693b-151e-43fd-81ab-fad27e53df7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61723e9e70f642ac9b6cd8a6a2c67cb9, user_id=006afc3076bd4cfc99c722e54c687dc8, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.883967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda693b-151e-43fd-81ab-fad27e53df7f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.890035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d79d21bae9a48458c94b35d907897d0', 'request_id': 'req-9861e2e3-571e-4973-99fb-99f01c0135bd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.895150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 940/1863] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:59 2022] PUT /identity/v3/projects/61723e9e70f642ac9b6cd8a6a2c67cb9/users/006afc3076bd4cfc99c722e54c687dc8/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:59.896651 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda693b-151e-43fd-81ab-fad27e53df7f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.905869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d79d21bae9a48458c94b35d907897d0', 'request_id': 'req-9861e2e3-571e-4973-99fb-99f01c0135bd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.913731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d79d21bae9a48458c94b35d907897d0', 'request_id': 'req-9861e2e3-571e-4973-99fb-99f01c0135bd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.915717 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:59.928826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] The token cache is being invalidate because project 2d79d21bae9a48458c94b35d907897d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:59.929046 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.929846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9861e2e3-571e-4973-99fb-99f01c0135bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.931744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 924/1864] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:59 2022] DELETE /identity/v3/projects/2d79d21bae9a48458c94b35d907897d0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:59.935029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af30cfe-54cb-4865-8a1c-a6c8b7d855ff None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.935029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af30cfe-54cb-4865-8a1c-a6c8b7d855ff None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.935029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af30cfe-54cb-4865-8a1c-a6c8b7d855ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.961451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3af30cfe-54cb-4865-8a1c-a6c8b7d855ff None None] MFA Rules not processed for user `006afc3076bd4cfc99c722e54c687dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:59.962671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3af30cfe-54cb-4865-8a1c-a6c8b7d855ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:59.968874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda693b-151e-43fd-81ab-fad27e53df7f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.973523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5d4a8-c023-489a-b3ee-8976ca7e033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.974940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5d4a8-c023-489a-b3ee-8976ca7e033a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.975214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5d4a8-c023-489a-b3ee-8976ca7e033a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.975498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5d4a8-c023-489a-b3ee-8976ca7e033a admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.976230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5d4a8-c023-489a-b3ee-8976ca7e033a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.977885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5d4a8-c023-489a-b3ee-8976ca7e033a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.988175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 941/1865] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:59.989999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5d4a8-c023-489a-b3ee-8976ca7e033a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.993484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-25d5d4a8-c023-489a-b3ee-8976ca7e033a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.007370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5d4a8-c023-489a-b3ee-8976ca7e033a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:00.011896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:00.012796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:00.013079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:00.013357 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] PATH_INFO: `/v3/users/02229d2bb4814593b994b174a656f1c6` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.014568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02229d2bb4814593b994b174a656f1c6)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:00.016484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:00.039197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 925/1866] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:00.040422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af30cfe-54cb-4865-8a1c-a6c8b7d855ff None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:00.041769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3af30cfe-54cb-4865-8a1c-a6c8b7d855ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.057757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af30cfe-54cb-4865-8a1c-a6c8b7d855ff None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:00.062512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf2444-38b1-4147-9e67-e9f82e792c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:00.063401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2444-38b1-4147-9e67-e9f82e792c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:00.063690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2444-38b1-4147-9e67-e9f82e792c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:00.063970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2444-38b1-4147-9e67-e9f82e792c2b admin admin] PATH_INFO: `/v3/projects/2607db08d78849eaa7ef75c43ad72a3d/users/ce75ccac727e47f6a3b792f1cf5eb8a8/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.070771 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02229d2bb4814593b994b174a656f1c6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:00.079002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02229d2bb4814593b994b174a656f1c6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:00.080149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02229d2bb4814593b994b174a656f1c6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:00.081165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02229d2bb4814593b994b174a656f1c6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:00.082941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf2444-38b1-4147-9e67-e9f82e792c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2607db08d78849eaa7ef75c43ad72a3d, user_id=ce75ccac727e47f6a3b792f1cf5eb8a8, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:00.087306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf2444-38b1-4147-9e67-e9f82e792c2b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:00.102902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02229d2bb4814593b994b174a656f1c6'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:00.104867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:00.108373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 926/1867] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:00 2022] PUT /identity/v3/projects/2607db08d78849eaa7ef75c43ad72a3d/users/ce75ccac727e47f6a3b792f1cf5eb8a8/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:00.109324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf2444-38b1-4147-9e67-e9f82e792c2b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:00.111217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-75bf2444-38b1-4147-9e67-e9f82e792c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.132909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 942/1868] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:59 2022] DELETE /identity/v3/users/02229d2bb4814593b994b174a656f1c6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:00.136908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:00.141777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.186903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf2444-38b1-4147-9e67-e9f82e792c2b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:00.239018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81e521-f9f7-47fe-940b-a442195ab427 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:00.248734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38b30f-fb24-4a3e-a2c3-18ab117f385e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:00.249883 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b30f-fb24-4a3e-a2c3-18ab117f385e admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:00.250619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b30f-fb24-4a3e-a2c3-18ab117f385e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:00.252537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b30f-fb24-4a3e-a2c3-18ab117f385e admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.254706 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38b30f-fb24-4a3e-a2c3-18ab117f385e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:00.257518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38b30f-fb24-4a3e-a2c3-18ab117f385e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:00.259385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e9325-7744-4b0d-b2a4-f5bce12f824e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:00.260110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e9325-7744-4b0d-b2a4-f5bce12f824e service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:00.260407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e9325-7744-4b0d-b2a4-f5bce12f824e service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:00.260718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e9325-7744-4b0d-b2a4-f5bce12f824e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.271418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-734e9325-7744-4b0d-b2a4-f5bce12f824e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.274986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 943/1869] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:00.275526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38b30f-fb24-4a3e-a2c3-18ab117f385e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:00.290312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38b30f-fb24-4a3e-a2c3-18ab117f385e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:00.295785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6a045-397b-485a-91e9-505475cad452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:00.296867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6a045-397b-485a-91e9-505475cad452 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:00.297198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6a045-397b-485a-91e9-505475cad452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:00.297588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6a045-397b-485a-91e9-505475cad452 admin admin] PATH_INFO: `/v3/projects/2607db08d78849eaa7ef75c43ad72a3d/users/ce75ccac727e47f6a3b792f1cf5eb8a8/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.300699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6a045-397b-485a-91e9-505475cad452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2607db08d78849eaa7ef75c43ad72a3d, user_id=ce75ccac727e47f6a3b792f1cf5eb8a8, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:00.303616 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:00.304553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6a045-397b-485a-91e9-505475cad452 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:00.323312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 944/1870] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:00 2022] PUT /identity/v3/projects/2607db08d78849eaa7ef75c43ad72a3d/users/ce75ccac727e47f6a3b792f1cf5eb8a8/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:00.335196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bf3a-48d1-49b2-a013-1c83bc564fe9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:00.335417 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bf3a-48d1-49b2-a013-1c83bc564fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:00.335698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bf3a-48d1-49b2-a013-1c83bc564fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.379545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e9325-7744-4b0d-b2a4-f5bce12f824e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:00.382079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e9325-7744-4b0d-b2a4-f5bce12f824e service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:00.407777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8da4bf3a-48d1-49b2-a013-1c83bc564fe9 None None] MFA Rules not processed for user `ce75ccac727e47f6a3b792f1cf5eb8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:00.409053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8da4bf3a-48d1-49b2-a013-1c83bc564fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.415826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 927/1871] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:00.545096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 945/1872] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:00.576383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e9325-7744-4b0d-b2a4-f5bce12f824e service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:00.576383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-734e9325-7744-4b0d-b2a4-f5bce12f824e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.577772 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4bf3a-48d1-49b2-a013-1c83bc564fe9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:00.580261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8da4bf3a-48d1-49b2-a013-1c83bc564fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.612906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e9325-7744-4b0d-b2a4-f5bce12f824e service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:00.684699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a4ce2-a164-4f18-a252-8abb6d2e7db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:00.685452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a4ce2-a164-4f18-a252-8abb6d2e7db7 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:00.685818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a4ce2-a164-4f18-a252-8abb6d2e7db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:00.686161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a4ce2-a164-4f18-a252-8abb6d2e7db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.699997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4bf3a-48d1-49b2-a013-1c83bc564fe9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:00.706137 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:00.707151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:00.707510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:00.707909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] PATH_INFO: `/v3/projects/531c9e4d247b492693a0681a69cfc3b7` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.709864 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=531c9e4d247b492693a0681a69cfc3b7)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:00.711432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a4ce2-a164-4f18-a252-8abb6d2e7db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:00.712286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:00.714515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:00.715977 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a4ce2-a164-4f18-a252-8abb6d2e7db7 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:00.737607 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 928/1873] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:00.832896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531c9e4d247b492693a0681a69cfc3b7', 'request_id': 'req-363243a6-689d-474b-994e-6f8841ef2b9f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:00.854172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531c9e4d247b492693a0681a69cfc3b7', 'request_id': 'req-363243a6-689d-474b-994e-6f8841ef2b9f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:00.870003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531c9e4d247b492693a0681a69cfc3b7', 'request_id': 'req-363243a6-689d-474b-994e-6f8841ef2b9f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:00.878501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a4ce2-a164-4f18-a252-8abb6d2e7db7 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:00.898039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] The token cache is being invalidate because project 531c9e4d247b492693a0681a69cfc3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:00.898347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:00.898946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a4ce2-a164-4f18-a252-8abb6d2e7db7 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:00.899284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:00.903141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 946/1874] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:00 2022] DELETE /identity/v3/projects/531c9e4d247b492693a0681a69cfc3b7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:00.907640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:00.909489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:01.054737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363243a6-689d-474b-994e-6f8841ef2b9f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:01.057463 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99aa59-1ded-4c71-bba7-8f0c87fcebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:01.058468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99aa59-1ded-4c71-bba7-8f0c87fcebaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:01.059770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99aa59-1ded-4c71-bba7-8f0c87fcebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:01.060772 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:01.060901 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99aa59-1ded-4c71-bba7-8f0c87fcebaa admin admin] PATH_INFO: `/v3/users/646d28b673294d669aeecf38397c32d6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:01.062238 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:01.062621 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:01.062749 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99aa59-1ded-4c71-bba7-8f0c87fcebaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=646d28b673294d669aeecf38397c32d6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:01.062924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] PATH_INFO: `/v3/users/553b07f3462b4a71aad82a9d8bc3ae71` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:01.065051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] RBAC: Authorizing `identity:delete_user(user_id=553b07f3462b4a71aad82a9d8bc3ae71)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:01.067288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99aa59-1ded-4c71-bba7-8f0c87fcebaa admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:01.069195 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:01.156049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cb99aa59-1ded-4c71-bba7-8f0c87fcebaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646d28b673294d669aeecf38397c32d6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.166986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553b07f3462b4a71aad82a9d8bc3ae71'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.167651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cb99aa59-1ded-4c71-bba7-8f0c87fcebaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646d28b673294d669aeecf38397c32d6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.168738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cb99aa59-1ded-4c71-bba7-8f0c87fcebaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646d28b673294d669aeecf38397c32d6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.170041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cb99aa59-1ded-4c71-bba7-8f0c87fcebaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646d28b673294d669aeecf38397c32d6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.177945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553b07f3462b4a71aad82a9d8bc3ae71'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.181395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553b07f3462b4a71aad82a9d8bc3ae71'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.182386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553b07f3462b4a71aad82a9d8bc3ae71'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.185989 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:01.197271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cb99aa59-1ded-4c71-bba7-8f0c87fcebaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646d28b673294d669aeecf38397c32d6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.207090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553b07f3462b4a71aad82a9d8bc3ae71'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.217137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 929/1875] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:00 2022] DELETE /identity/v3/users/646d28b673294d669aeecf38397c32d6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:01.221880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2800-dd5b-40ce-bb2d-0d57fe94e41a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:01.222302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2800-dd5b-40ce-bb2d-0d57fe94e41a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:01.222798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2800-dd5b-40ce-bb2d-0d57fe94e41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:01.231022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 947/1876] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:00 2022] DELETE /identity/v3/users/553b07f3462b4a71aad82a9d8bc3ae71 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:01.257105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-975e2800-dd5b-40ce-bb2d-0d57fe94e41a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:01.258466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-975e2800-dd5b-40ce-bb2d-0d57fe94e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:01.296509 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:01.299141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:01.322076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:01.381462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 930/1877] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:01.389854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e27a2-f070-4e03-8bf7-1239013f263a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:01.395060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37b72b-e028-4129-b1e3-3fe078382557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:01.397104 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37b72b-e028-4129-b1e3-3fe078382557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:01.397655 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37b72b-e028-4129-b1e3-3fe078382557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:01.398072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37b72b-e028-4129-b1e3-3fe078382557 admin admin] PATH_INFO: `/v3/users/a917deda8c1d482e86359eb94ee9c773` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:01.399306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e2800-dd5b-40ce-bb2d-0d57fe94e41a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:01.399687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37b72b-e028-4129-b1e3-3fe078382557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a917deda8c1d482e86359eb94ee9c773)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:01.400829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-975e2800-dd5b-40ce-bb2d-0d57fe94e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:01.402031 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37b72b-e028-4129-b1e3-3fe078382557 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:01.461211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1e37b72b-e028-4129-b1e3-3fe078382557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a917deda8c1d482e86359eb94ee9c773'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.471087 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1e37b72b-e028-4129-b1e3-3fe078382557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a917deda8c1d482e86359eb94ee9c773'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.472359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1e37b72b-e028-4129-b1e3-3fe078382557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a917deda8c1d482e86359eb94ee9c773'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.473029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1e37b72b-e028-4129-b1e3-3fe078382557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a917deda8c1d482e86359eb94ee9c773'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.490802 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1e37b72b-e028-4129-b1e3-3fe078382557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a917deda8c1d482e86359eb94ee9c773'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:01.502078 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e2800-dd5b-40ce-bb2d-0d57fe94e41a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:01.507098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988be01-ede1-4306-b816-2642db244a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:01.507759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988be01-ede1-4306-b816-2642db244a93 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:01.508049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988be01-ede1-4306-b816-2642db244a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:01.508333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988be01-ede1-4306-b816-2642db244a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:01.510507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4988be01-ede1-4306-b816-2642db244a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:01.511773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 948/1878] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:01 2022] DELETE /identity/v3/users/a917deda8c1d482e86359eb94ee9c773 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:01.516930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a978eb4-f4e5-4426-b2c2-dad76e78e7b4 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:01.517226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a978eb4-f4e5-4426-b2c2-dad76e78e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:01.517511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a978eb4-f4e5-4426-b2c2-dad76e78e7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:01.525216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988be01-ede1-4306-b816-2642db244a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:01.527774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988be01-ede1-4306-b816-2642db244a93 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:01.539163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8a978eb4-f4e5-4426-b2c2-dad76e78e7b4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:01.540580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8a978eb4-f4e5-4426-b2c2-dad76e78e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:01.545461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 931/1879] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:01.606003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 949/1880] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:01.640485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988be01-ede1-4306-b816-2642db244a93 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:01.641988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4988be01-ede1-4306-b816-2642db244a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:01.658384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988be01-ede1-4306-b816-2642db244a93 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:01.727978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ec78-107c-4972-a5b1-1cab2bea1df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:01.728682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ec78-107c-4972-a5b1-1cab2bea1df2 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:01.728973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ec78-107c-4972-a5b1-1cab2bea1df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:01.729256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ec78-107c-4972-a5b1-1cab2bea1df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:01.740649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4ec78-107c-4972-a5b1-1cab2bea1df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:01.742438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4ec78-107c-4972-a5b1-1cab2bea1df2 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:01.753362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 932/1881] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:02.034824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a978eb4-f4e5-4426-b2c2-dad76e78e7b4 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.036595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8a978eb4-f4e5-4426-b2c2-dad76e78e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.050907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a978eb4-f4e5-4426-b2c2-dad76e78e7b4 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.068020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.069020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.069224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.069503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] PATH_INFO: `/v3/projects/0dfe21d6bcab4fab924b92e78417f8b1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.073494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dfe21d6bcab4fab924b92e78417f8b1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.075942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.137332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:02.180336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfe21d6bcab4fab924b92e78417f8b1', 'request_id': 'req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.199982 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfe21d6bcab4fab924b92e78417f8b1', 'request_id': 'req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.215181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfe21d6bcab4fab924b92e78417f8b1', 'request_id': 'req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.228549 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] The token cache is being invalidate because project 0dfe21d6bcab4fab924b92e78417f8b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:02.228871 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.229548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-02b01ac1-7727-4dd5-9b5f-31a89aa132c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.236543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 950/1882] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:02 2022] DELETE /identity/v3/projects/0dfe21d6bcab4fab924b92e78417f8b1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:02.237628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e0d6-8c28-4906-9699-e86640991163 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.238515 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e0d6-8c28-4906-9699-e86640991163 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.239137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e0d6-8c28-4906-9699-e86640991163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.277251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4cf6e0d6-8c28-4906-9699-e86640991163 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:02.278547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4cf6e0d6-8c28-4906-9699-e86640991163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.305396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:02.365237 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 933/1883] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:02.374533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae71b86-32d0-432d-b223-a9ee545991ef None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.374819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae71b86-32d0-432d-b223-a9ee545991ef None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.375104 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae71b86-32d0-432d-b223-a9ee545991ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.401657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8ae71b86-32d0-432d-b223-a9ee545991ef None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:02.402855 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8ae71b86-32d0-432d-b223-a9ee545991ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.413135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 951/1884] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:02.417139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6e0d6-8c28-4906-9699-e86640991163 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.422466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae71b86-32d0-432d-b223-a9ee545991ef None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.424183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8ae71b86-32d0-432d-b223-a9ee545991ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.444506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6e0d6-8c28-4906-9699-e86640991163 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.457836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae71b86-32d0-432d-b223-a9ee545991ef None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.460045 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5aa2a-053f-478c-91c0-75766af4572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.460904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5aa2a-053f-478c-91c0-75766af4572c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.461285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5aa2a-053f-478c-91c0-75766af4572c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.461637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5aa2a-053f-478c-91c0-75766af4572c admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.462456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5aa2a-053f-478c-91c0-75766af4572c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:02.462845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5aa2a-053f-478c-91c0-75766af4572c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.464555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5aa2a-053f-478c-91c0-75766af4572c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.471753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.473705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.473705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.473903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] PATH_INFO: `/v3/projects/00c568f574f7475887ce7ff81db4f0ff` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.475911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c568f574f7475887ce7ff81db4f0ff)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.478919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.486806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 934/1885] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:02.488345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5aa2a-053f-478c-91c0-75766af4572c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.509441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5aa2a-053f-478c-91c0-75766af4572c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.515071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc82b0-d727-43ae-975a-a2ae3eb977a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.515815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc82b0-d727-43ae-975a-a2ae3eb977a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.524112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc82b0-d727-43ae-975a-a2ae3eb977a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.524427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc82b0-d727-43ae-975a-a2ae3eb977a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.525444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc82b0-d727-43ae-975a-a2ae3eb977a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.528109 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc82b0-d727-43ae-975a-a2ae3eb977a6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.547980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c568f574f7475887ce7ff81db4f0ff', 'request_id': 'req-4603dc3c-114c-47e7-867f-3e688534573d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.556135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c568f574f7475887ce7ff81db4f0ff', 'request_id': 'req-4603dc3c-114c-47e7-867f-3e688534573d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.560255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 935/1886] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:02 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:02.560953 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc82b0-d727-43ae-975a-a2ae3eb977a6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.562991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c2dc82b0-d727-43ae-975a-a2ae3eb977a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.568628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c568f574f7475887ce7ff81db4f0ff', 'request_id': 'req-4603dc3c-114c-47e7-867f-3e688534573d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.584333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] The token cache is being invalidate because project 00c568f574f7475887ce7ff81db4f0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:02.584650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.585622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.587332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 952/1887] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:02 2022] DELETE /identity/v3/projects/00c568f574f7475887ce7ff81db4f0ff => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:02.588430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.590256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.648702 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc82b0-d727-43ae-975a-a2ae3eb977a6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.655706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.656592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.656940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.657375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] PATH_INFO: `/v3/projects/57218bcc412a4aff9c5e902ec71adcd9` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.658714 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=57218bcc412a4aff9c5e902ec71adcd9)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.662330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.680584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603dc3c-114c-47e7-867f-3e688534573d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.685954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b3e05-05d2-4b59-8aa3-76d13f38a216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.686681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b3e05-05d2-4b59-8aa3-76d13f38a216 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.687096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b3e05-05d2-4b59-8aa3-76d13f38a216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.687387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b3e05-05d2-4b59-8aa3-76d13f38a216 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.688086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b3e05-05d2-4b59-8aa3-76d13f38a216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.690843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b3e05-05d2-4b59-8aa3-76d13f38a216 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.713412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 953/1888] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:02 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:02.714328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b3e05-05d2-4b59-8aa3-76d13f38a216 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.716539 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-269b3e05-05d2-4b59-8aa3-76d13f38a216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.725644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57218bcc412a4aff9c5e902ec71adcd9', 'request_id': 'req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.733961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57218bcc412a4aff9c5e902ec71adcd9', 'request_id': 'req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.734559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b3e05-05d2-4b59-8aa3-76d13f38a216 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.743167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57218bcc412a4aff9c5e902ec71adcd9', 'request_id': 'req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.757844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=82,keystone:DELETE=13,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:02.759933 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] The token cache is being invalidate because project 57218bcc412a4aff9c5e902ec71adcd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:02.760330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.761255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.766510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 936/1889] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:02 2022] DELETE /identity/v3/projects/57218bcc412a4aff9c5e902ec71adcd9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:02.766510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.766510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.800937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:02.838746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.840477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.840875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.841437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] PATH_INFO: `/v3/users/ce75ccac727e47f6a3b792f1cf5eb8a8` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.842814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce75ccac727e47f6a3b792f1cf5eb8a8)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.845992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.858935 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7d3f-c6a7-4d97-867d-855adf8ad3fa admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.867348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8d383-bd3b-40ad-bb9e-b94666959c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.868174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d383-bd3b-40ad-bb9e-b94666959c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.868526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d383-bd3b-40ad-bb9e-b94666959c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.869523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d383-bd3b-40ad-bb9e-b94666959c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.869732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8d383-bd3b-40ad-bb9e-b94666959c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.871975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8d383-bd3b-40ad-bb9e-b94666959c62 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.890250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 937/1890] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:02.890250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8d383-bd3b-40ad-bb9e-b94666959c62 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.891865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-23c8d383-bd3b-40ad-bb9e-b94666959c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.906382 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8d383-bd3b-40ad-bb9e-b94666959c62 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:02.911216 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce75ccac727e47f6a3b792f1cf5eb8a8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.911947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:02.912978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.913338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.913631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] PATH_INFO: `/v3/users/006afc3076bd4cfc99c722e54c687dc8` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.914950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=006afc3076bd4cfc99c722e54c687dc8)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:02.917005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:02.919783 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce75ccac727e47f6a3b792f1cf5eb8a8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.920503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce75ccac727e47f6a3b792f1cf5eb8a8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.921161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce75ccac727e47f6a3b792f1cf5eb8a8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.935129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce75ccac727e47f6a3b792f1cf5eb8a8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.949712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 954/1891] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:02 2022] DELETE /identity/v3/users/ce75ccac727e47f6a3b792f1cf5eb8a8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:02.950971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:02.953331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.980926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006afc3076bd4cfc99c722e54c687dc8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.992300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006afc3076bd4cfc99c722e54c687dc8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.993776 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006afc3076bd4cfc99c722e54c687dc8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:02.994434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006afc3076bd4cfc99c722e54c687dc8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:03.014021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006afc3076bd4cfc99c722e54c687dc8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:03.046567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 938/1892] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:02 2022] DELETE /identity/v3/users/006afc3076bd4cfc99c722e54c687dc8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:03.048017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.049644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:03.063211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d449af-9af3-4c74-b8f5-29942f26890b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.141633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84317887-6fb5-4577-8305-5c1d3d904b00 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.154600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29c4ef-2884-4b5c-b160-4f713ab33adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.155302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29c4ef-2884-4b5c-b160-4f713ab33adc admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.155603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29c4ef-2884-4b5c-b160-4f713ab33adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.155973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29c4ef-2884-4b5c-b160-4f713ab33adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.156993 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29c4ef-2884-4b5c-b160-4f713ab33adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.160727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29c4ef-2884-4b5c-b160-4f713ab33adc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.177817 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 939/1893] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:03.182585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:03.183107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29c4ef-2884-4b5c-b160-4f713ab33adc admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.216811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29c4ef-2884-4b5c-b160-4f713ab33adc admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.217684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45ce75-13b6-4e63-896d-68ef3e57390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.219360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45ce75-13b6-4e63-896d-68ef3e57390d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.219643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45ce75-13b6-4e63-896d-68ef3e57390d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.220376 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45ce75-13b6-4e63-896d-68ef3e57390d admin admin] PATH_INFO: `/v3/users/7fb674a5d31e48d4997308fa093209e4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.225334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45ce75-13b6-4e63-896d-68ef3e57390d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb674a5d31e48d4997308fa093209e4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.231628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11cc3-5f8e-4dba-9e41-d699540d1245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.233192 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45ce75-13b6-4e63-896d-68ef3e57390d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.235337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11cc3-5f8e-4dba-9e41-d699540d1245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.235648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11cc3-5f8e-4dba-9e41-d699540d1245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.235934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11cc3-5f8e-4dba-9e41-d699540d1245 admin admin] PATH_INFO: `/v3/projects/0edf24e521d94240b9792adcb3e6f9e9/users/345c2a49dece4409b98d5276eaa98f3f/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.292913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d11cc3-5f8e-4dba-9e41-d699540d1245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0edf24e521d94240b9792adcb3e6f9e9, user_id=345c2a49dece4409b98d5276eaa98f3f, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.302578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d11cc3-5f8e-4dba-9e41-d699540d1245 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.348841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 940/1894] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:03 2022] PUT /identity/v3/projects/0edf24e521d94240b9792adcb3e6f9e9/users/345c2a49dece4409b98d5276eaa98f3f/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:03.359650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62bdb-54de-40e0-9436-b64c4cc38589 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.360002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62bdb-54de-40e0-9436-b64c4cc38589 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.360377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62bdb-54de-40e0-9436-b64c4cc38589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.388651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:03.389594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ce45ce75-13b6-4e63-896d-68ef3e57390d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb674a5d31e48d4997308fa093209e4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:03.420785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ce45ce75-13b6-4e63-896d-68ef3e57390d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb674a5d31e48d4997308fa093209e4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:03.439640 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ce45ce75-13b6-4e63-896d-68ef3e57390d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb674a5d31e48d4997308fa093209e4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:03.441828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ce45ce75-13b6-4e63-896d-68ef3e57390d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb674a5d31e48d4997308fa093209e4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:03.462654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6ce62bdb-54de-40e0-9436-b64c4cc38589 None None] MFA Rules not processed for user `345c2a49dece4409b98d5276eaa98f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:03.464245 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6ce62bdb-54de-40e0-9436-b64c4cc38589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:03.486839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ce45ce75-13b6-4e63-896d-68ef3e57390d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb674a5d31e48d4997308fa093209e4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:03.529603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 955/1895] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:02 2022] DELETE /identity/v3/users/7fb674a5d31e48d4997308fa093209e4 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:03.533078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e2b52-4039-47f4-9696-d067b89a9332 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.533414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e2b52-4039-47f4-9696-d067b89a9332 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.533636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e2b52-4039-47f4-9696-d067b89a9332 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.535140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 956/1896] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:14:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:14:03.538553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbc00c-1f34-42c8-be1c-89dff80e698f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.538847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbc00c-1f34-42c8-be1c-89dff80e698f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.539129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbc00c-1f34-42c8-be1c-89dff80e698f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.551520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 941/1897] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:03.556465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62bdb-54de-40e0-9436-b64c4cc38589 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.562772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6ce62bdb-54de-40e0-9436-b64c4cc38589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:03.571049 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a3cbc00c-1f34-42c8-be1c-89dff80e698f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:03.572102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a3cbc00c-1f34-42c8-be1c-89dff80e698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:03.643458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 957/1898] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:03.644979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee83ed-574a-4059-b852-df118cb54f5c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.645272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee83ed-574a-4059-b852-df118cb54f5c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.645552 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee83ed-574a-4059-b852-df118cb54f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.666491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62bdb-54de-40e0-9436-b64c4cc38589 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.672227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e90af-d709-44a5-a49f-6043d7c1a88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.673221 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e90af-d709-44a5-a49f-6043d7c1a88b admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.673513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e90af-d709-44a5-a49f-6043d7c1a88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.673884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e90af-d709-44a5-a49f-6043d7c1a88b admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.674501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e90af-d709-44a5-a49f-6043d7c1a88b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.674628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-01ee83ed-574a-4059-b852-df118cb54f5c None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:03.676233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-01ee83ed-574a-4059-b852-df118cb54f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:03.676438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e90af-d709-44a5-a49f-6043d7c1a88b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.707378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 942/1899] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:03 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:03.708311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e90af-d709-44a5-a49f-6043d7c1a88b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.710314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-538e90af-d709-44a5-a49f-6043d7c1a88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:03.747676 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:03.773620 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 958/1900] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:14:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:03.779781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e90af-d709-44a5-a49f-6043d7c1a88b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.780791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee83ed-574a-4059-b852-df118cb54f5c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.783841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933584e2-8f97-42f8-b95c-4b9c8f8fc533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.784639 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933584e2-8f97-42f8-b95c-4b9c8f8fc533 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.785036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933584e2-8f97-42f8-b95c-4b9c8f8fc533 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.785704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933584e2-8f97-42f8-b95c-4b9c8f8fc533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.792353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee83ed-574a-4059-b852-df118cb54f5c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.824585 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:03.872849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933584e2-8f97-42f8-b95c-4b9c8f8fc533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.873808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e657d5-791c-4c9a-913c-629ee770b670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.874488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e657d5-791c-4c9a-913c-629ee770b670 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.874776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e657d5-791c-4c9a-913c-629ee770b670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.875056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e657d5-791c-4c9a-913c-629ee770b670 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.875767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e657d5-791c-4c9a-913c-629ee770b670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.876762 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933584e2-8f97-42f8-b95c-4b9c8f8fc533 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.877755 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e657d5-791c-4c9a-913c-629ee770b670 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:03.893020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 943/1901] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:03.895081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933584e2-8f97-42f8-b95c-4b9c8f8fc533 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.896824 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-933584e2-8f97-42f8-b95c-4b9c8f8fc533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:03.933429 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 959/1902] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:03 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:03.936992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e657d5-791c-4c9a-913c-629ee770b670 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:03.954164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e657d5-791c-4c9a-913c-629ee770b670 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:03.978632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89709d7-10f8-462a-b58f-5eab47f285cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:03.979253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89709d7-10f8-462a-b58f-5eab47f285cc admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:03.979597 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89709d7-10f8-462a-b58f-5eab47f285cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:03.979883 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89709d7-10f8-462a-b58f-5eab47f285cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:03.980660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89709d7-10f8-462a-b58f-5eab47f285cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:03.982311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89709d7-10f8-462a-b58f-5eab47f285cc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:04.015388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 960/1903] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:04.016351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89709d7-10f8-462a-b58f-5eab47f285cc admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:04.024359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d89709d7-10f8-462a-b58f-5eab47f285cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.027961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933584e2-8f97-42f8-b95c-4b9c8f8fc533 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:04.034537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff119222-8355-4b7d-98e4-700b4d53bb9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:04.035666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff119222-8355-4b7d-98e4-700b4d53bb9b service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.037557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff119222-8355-4b7d-98e4-700b4d53bb9b service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.037557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff119222-8355-4b7d-98e4-700b4d53bb9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.049885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff119222-8355-4b7d-98e4-700b4d53bb9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:04.051896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff119222-8355-4b7d-98e4-700b4d53bb9b service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:04.057038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89709d7-10f8-462a-b58f-5eab47f285cc admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:04.072321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:04.073242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.074042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.074042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] PATH_INFO: `/v3/projects/2607db08d78849eaa7ef75c43ad72a3d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.076653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2607db08d78849eaa7ef75c43ad72a3d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:04.078659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:04.082554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 944/1904] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:04.084255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff119222-8355-4b7d-98e4-700b4d53bb9b service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:04.097949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff119222-8355-4b7d-98e4-700b4d53bb9b service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:04.104412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43a4a-cee3-4f79-88a1-a26b0b21dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:04.106453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43a4a-cee3-4f79-88a1-a26b0b21dd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.106753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43a4a-cee3-4f79-88a1-a26b0b21dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.107040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43a4a-cee3-4f79-88a1-a26b0b21dd9b admin admin] PATH_INFO: `/v3/projects/57537fa4eda142368b8c81d0376c23a2/users/203a27138ac94c1194ae385b4dc1f5f1/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.130571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e43a4a-cee3-4f79-88a1-a26b0b21dd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57537fa4eda142368b8c81d0376c23a2, user_id=203a27138ac94c1194ae385b4dc1f5f1, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:04.134110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e43a4a-cee3-4f79-88a1-a26b0b21dd9b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:04.162217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 945/1905] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:04 2022] PUT /identity/v3/projects/57537fa4eda142368b8c81d0376c23a2/users/203a27138ac94c1194ae385b4dc1f5f1/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:04.164603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43a4a-cee3-4f79-88a1-a26b0b21dd9b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:04.185353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2607db08d78849eaa7ef75c43ad72a3d', 'request_id': 'req-e9fd4ad3-417e-49be-9620-be12216fe024'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.199949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2607db08d78849eaa7ef75c43ad72a3d', 'request_id': 'req-e9fd4ad3-417e-49be-9620-be12216fe024'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.216389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2607db08d78849eaa7ef75c43ad72a3d', 'request_id': 'req-e9fd4ad3-417e-49be-9620-be12216fe024'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.230471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] The token cache is being invalidate because project 2607db08d78849eaa7ef75c43ad72a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:04.230807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.231641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e9fd4ad3-417e-49be-9620-be12216fe024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.233867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 961/1906] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:04 2022] DELETE /identity/v3/projects/2607db08d78849eaa7ef75c43ad72a3d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:04.238375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38010141-c78e-42ec-b29a-cb1493cd8791 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.238778 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38010141-c78e-42ec-b29a-cb1493cd8791 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.239150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38010141-c78e-42ec-b29a-cb1493cd8791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.264077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-38010141-c78e-42ec-b29a-cb1493cd8791 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:04.265477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-38010141-c78e-42ec-b29a-cb1493cd8791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.285085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43a4a-cee3-4f79-88a1-a26b0b21dd9b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:04.334849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:04.342486 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:04.360900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 962/1907] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:04.363231 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38010141-c78e-42ec-b29a-cb1493cd8791 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:04.365306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-38010141-c78e-42ec-b29a-cb1493cd8791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.369768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4f321-4292-4927-8ce1-3fbf7e1ee0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:04.370454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4f321-4292-4927-8ce1-3fbf7e1ee0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.370746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4f321-4292-4927-8ce1-3fbf7e1ee0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.371082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4f321-4292-4927-8ce1-3fbf7e1ee0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.371887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4f321-4292-4927-8ce1-3fbf7e1ee0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:04.373802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4f321-4292-4927-8ce1-3fbf7e1ee0c2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:04.385445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38010141-c78e-42ec-b29a-cb1493cd8791 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:04.386063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 946/1908] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:04.387861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1594a-8438-42f9-8935-6b84888adba4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.388167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1594a-8438-42f9-8935-6b84888adba4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.388670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1594a-8438-42f9-8935-6b84888adba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.394354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:04.395238 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.395529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.395816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] PATH_INFO: `/v3/projects/61723e9e70f642ac9b6cd8a6a2c67cb9` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.397204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61723e9e70f642ac9b6cd8a6a2c67cb9)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:04.402169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:04.409109 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2ab1594a-8438-42f9-8935-6b84888adba4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:04.410605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2ab1594a-8438-42f9-8935-6b84888adba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.419402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 947/1909] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:04.423632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1594a-8438-42f9-8935-6b84888adba4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:04.425354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2ab1594a-8438-42f9-8935-6b84888adba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.440316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1594a-8438-42f9-8935-6b84888adba4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:04.445840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34c627-5994-4954-bc57-19641135cedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:04.447056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c627-5994-4954-bc57-19641135cedf admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.447437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c627-5994-4954-bc57-19641135cedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.447617 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c627-5994-4954-bc57-19641135cedf admin admin] PATH_INFO: `/v3/projects/57537fa4eda142368b8c81d0376c23a2/users/203a27138ac94c1194ae385b4dc1f5f1/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.450095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34c627-5994-4954-bc57-19641135cedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=57537fa4eda142368b8c81d0376c23a2, user_id=203a27138ac94c1194ae385b4dc1f5f1, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:04.452805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34c627-5994-4954-bc57-19641135cedf admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:04.464770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61723e9e70f642ac9b6cd8a6a2c67cb9', 'request_id': 'req-37c4df2a-69fa-4913-a969-e5c0d4d95d98'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.466261 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 948/1910] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:04 2022] PUT /identity/v3/projects/57537fa4eda142368b8c81d0376c23a2/users/203a27138ac94c1194ae385b4dc1f5f1/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:04.467094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34c627-5994-4954-bc57-19641135cedf admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:04.469359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-bf34c627-5994-4954-bc57-19641135cedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.473367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61723e9e70f642ac9b6cd8a6a2c67cb9', 'request_id': 'req-37c4df2a-69fa-4913-a969-e5c0d4d95d98'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.483452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61723e9e70f642ac9b6cd8a6a2c67cb9', 'request_id': 'req-37c4df2a-69fa-4913-a969-e5c0d4d95d98'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.495506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] The token cache is being invalidate because project 61723e9e70f642ac9b6cd8a6a2c67cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:04.495933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.496643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.498808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 963/1911] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:04 2022] DELETE /identity/v3/projects/61723e9e70f642ac9b6cd8a6a2c67cb9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:04.499725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:04.501187 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.551082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34c627-5994-4954-bc57-19641135cedf admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:04.556182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:04.557099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.557379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.557660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] PATH_INFO: `/v3/projects/19c2b580af574bf7949544f117042d65` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.559031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c2b580af574bf7949544f117042d65)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:04.561002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:04.575954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4df2a-69fa-4913-a969-e5c0d4d95d98 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:04.581303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890009d-4cb5-4914-8ab0-aaf901c95f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:04.581987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890009d-4cb5-4914-8ab0-aaf901c95f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.582279 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890009d-4cb5-4914-8ab0-aaf901c95f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.582565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890009d-4cb5-4914-8ab0-aaf901c95f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.583307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890009d-4cb5-4914-8ab0-aaf901c95f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:04.583688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890009d-4cb5-4914-8ab0-aaf901c95f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:04.585384 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890009d-4cb5-4914-8ab0-aaf901c95f80 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:04.600244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 964/1912] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:04.603778 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bb9a7-3747-49b1-a0c2-43af879bdab6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.604716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bb9a7-3747-49b1-a0c2-43af879bdab6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.605335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bb9a7-3747-49b1-a0c2-43af879bdab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.633278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c2b580af574bf7949544f117042d65', 'request_id': 'req-0abbd653-ab78-4860-996c-d2e3e82c922d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.640931 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c2b580af574bf7949544f117042d65', 'request_id': 'req-0abbd653-ab78-4860-996c-d2e3e82c922d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.648894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-251bb9a7-3747-49b1-a0c2-43af879bdab6 None None] MFA Rules not processed for user `203a27138ac94c1194ae385b4dc1f5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:04.649084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c2b580af574bf7949544f117042d65', 'request_id': 'req-0abbd653-ab78-4860-996c-d2e3e82c922d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.651011 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-251bb9a7-3747-49b1-a0c2-43af879bdab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.663582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] The token cache is being invalidate because project 19c2b580af574bf7949544f117042d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:04.663880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.664631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0abbd653-ab78-4860-996c-d2e3e82c922d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.668716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 949/1913] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:04 2022] DELETE /identity/v3/projects/19c2b580af574bf7949544f117042d65 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:04.671470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825c36-be3d-4b5d-9968-730368e4841c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.671858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825c36-be3d-4b5d-9968-730368e4841c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.672216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825c36-be3d-4b5d-9968-730368e4841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.693159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f4825c36-be3d-4b5d-9968-730368e4841c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:04.695183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f4825c36-be3d-4b5d-9968-730368e4841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.731192 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:04.735805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 965/1914] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:04.736686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bb9a7-3747-49b1-a0c2-43af879bdab6 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:04.746654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:04.753477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-251bb9a7-3747-49b1-a0c2-43af879bdab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.772048 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 950/1915] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:04.773174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4825c36-be3d-4b5d-9968-730368e4841c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:04.774652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f4825c36-be3d-4b5d-9968-730368e4841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.787071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4825c36-be3d-4b5d-9968-730368e4841c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:04.791890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0d07-733e-4dac-9889-db6fc34d1dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:04.792780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0d07-733e-4dac-9889-db6fc34d1dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.793069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0d07-733e-4dac-9889-db6fc34d1dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.793346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0d07-733e-4dac-9889-db6fc34d1dbe admin admin] PATH_INFO: `/v3/users/b8a4cca436a6485c9421485df8d1c321` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.794544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c0d07-733e-4dac-9889-db6fc34d1dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a4cca436a6485c9421485df8d1c321)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:04.796477 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c0d07-733e-4dac-9889-db6fc34d1dbe admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:04.821232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bb9a7-3747-49b1-a0c2-43af879bdab6 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:04.827350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a947050-3b22-4858-b798-88af4ede05f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:04.828032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a947050-3b22-4858-b798-88af4ede05f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.828576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a947050-3b22-4858-b798-88af4ede05f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.829072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a947050-3b22-4858-b798-88af4ede05f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.830226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a947050-3b22-4858-b798-88af4ede05f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:04.832831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a947050-3b22-4858-b798-88af4ede05f9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:04.855771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-951c0d07-733e-4dac-9889-db6fc34d1dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a4cca436a6485c9421485df8d1c321'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.863354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-951c0d07-733e-4dac-9889-db6fc34d1dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a4cca436a6485c9421485df8d1c321'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.864002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-951c0d07-733e-4dac-9889-db6fc34d1dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a4cca436a6485c9421485df8d1c321'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.865172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-951c0d07-733e-4dac-9889-db6fc34d1dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a4cca436a6485c9421485df8d1c321'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.873372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 966/1916] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:04 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:04.873372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a947050-3b22-4858-b798-88af4ede05f9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:04.875012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2a947050-3b22-4858-b798-88af4ede05f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.877523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-951c0d07-733e-4dac-9889-db6fc34d1dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a4cca436a6485c9421485df8d1c321'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:04.890774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 951/1917] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:04 2022] DELETE /identity/v3/users/b8a4cca436a6485c9421485df8d1c321 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:04.892116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af200d7-316b-458e-b761-56e42cee35f5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:04.892417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af200d7-316b-458e-b761-56e42cee35f5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:04.892728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af200d7-316b-458e-b761-56e42cee35f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:04.910553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5af200d7-316b-458e-b761-56e42cee35f5 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:04.912012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5af200d7-316b-458e-b761-56e42cee35f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:04.941551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a947050-3b22-4858-b798-88af4ede05f9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.004648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320884d-245d-4b45-9375-d528ed7bf93f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.008762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320884d-245d-4b45-9375-d528ed7bf93f service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.009067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320884d-245d-4b45-9375-d528ed7bf93f service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.009347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320884d-245d-4b45-9375-d528ed7bf93f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.015276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6320884d-245d-4b45-9375-d528ed7bf93f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:05.015638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 952/1918] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:05.016774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af200d7-316b-458e-b761-56e42cee35f5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.018899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5af200d7-316b-458e-b761-56e42cee35f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:05.033181 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af200d7-316b-458e-b761-56e42cee35f5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.039239 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa13df-2aba-4726-a432-09c9a64ab7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.040263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa13df-2aba-4726-a432-09c9a64ab7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.040806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa13df-2aba-4726-a432-09c9a64ab7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.041482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa13df-2aba-4726-a432-09c9a64ab7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.042406 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa13df-2aba-4726-a432-09c9a64ab7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.044698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa13df-2aba-4726-a432-09c9a64ab7b7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.079424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 953/1919] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:05 2022] POST /identity/v3/users => generated 290 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:05.081192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa13df-2aba-4726-a432-09c9a64ab7b7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.093919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa13df-2aba-4726-a432-09c9a64ab7b7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.101854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9508137-d9da-45f2-af43-2d5bcb130d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.102692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508137-d9da-45f2-af43-2d5bcb130d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.103088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508137-d9da-45f2-af43-2d5bcb130d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.103471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508137-d9da-45f2-af43-2d5bcb130d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.104320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9508137-d9da-45f2-af43-2d5bcb130d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:05.104783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9508137-d9da-45f2-af43-2d5bcb130d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.106511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9508137-d9da-45f2-af43-2d5bcb130d21 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.111549 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:05.134654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 954/1920] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:05.136937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9508137-d9da-45f2-af43-2d5bcb130d21 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.148374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320884d-245d-4b45-9375-d528ed7bf93f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.150487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320884d-245d-4b45-9375-d528ed7bf93f service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.151398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9508137-d9da-45f2-af43-2d5bcb130d21 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.161805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69729d12-ec84-418d-8f00-4e22973fad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.162754 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729d12-ec84-418d-8f00-4e22973fad58 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.163330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729d12-ec84-418d-8f00-4e22973fad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.163924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729d12-ec84-418d-8f00-4e22973fad58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.165746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69729d12-ec84-418d-8f00-4e22973fad58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.167488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69729d12-ec84-418d-8f00-4e22973fad58 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.172465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 967/1921] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:05.173337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320884d-245d-4b45-9375-d528ed7bf93f service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.186870 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 955/1922] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:05.187927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69729d12-ec84-418d-8f00-4e22973fad58 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.200592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320884d-245d-4b45-9375-d528ed7bf93f service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.202325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69729d12-ec84-418d-8f00-4e22973fad58 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.209094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0919f89-c0db-461b-a850-0ec405bbc53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.209812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0919f89-c0db-461b-a850-0ec405bbc53b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.210123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0919f89-c0db-461b-a850-0ec405bbc53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.210411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0919f89-c0db-461b-a850-0ec405bbc53b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.211207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0919f89-c0db-461b-a850-0ec405bbc53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.214330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69863eff-6624-4b53-901c-1b9f752f36d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.214993 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0919f89-c0db-461b-a850-0ec405bbc53b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.215137 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69863eff-6624-4b53-901c-1b9f752f36d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.215386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69863eff-6624-4b53-901c-1b9f752f36d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.215639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69863eff-6624-4b53-901c-1b9f752f36d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.216648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69863eff-6624-4b53-901c-1b9f752f36d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.221591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69863eff-6624-4b53-901c-1b9f752f36d6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.236352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 956/1923] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:05.240423 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0919f89-c0db-461b-a850-0ec405bbc53b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.254996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:05.272481 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0919f89-c0db-461b-a850-0ec405bbc53b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.288032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 968/1924] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:05 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:05.292886 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69863eff-6624-4b53-901c-1b9f752f36d6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.294819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34053c-41bb-465d-93da-1326b48b0cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.295849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34053c-41bb-465d-93da-1326b48b0cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.296141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34053c-41bb-465d-93da-1326b48b0cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.296424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34053c-41bb-465d-93da-1326b48b0cd7 admin admin] PATH_INFO: `/v3/projects/1fc98b4c4088461d8e7ef355f3dcf215/users/b516b4fdf6554c129280f5874eeabfae/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.339589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34053c-41bb-465d-93da-1326b48b0cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc98b4c4088461d8e7ef355f3dcf215, user_id=b516b4fdf6554c129280f5874eeabfae, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.339589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34053c-41bb-465d-93da-1326b48b0cd7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.362877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 957/1925] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:05 2022] PUT /identity/v3/projects/1fc98b4c4088461d8e7ef355f3dcf215/users/b516b4fdf6554c129280f5874eeabfae/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:05.374677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dc6f2-8cd8-4581-b5d3-5a0ab010b28a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.374983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dc6f2-8cd8-4581-b5d3-5a0ab010b28a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.375270 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dc6f2-8cd8-4581-b5d3-5a0ab010b28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.417314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d26dc6f2-8cd8-4581-b5d3-5a0ab010b28a None None] MFA Rules not processed for user `b516b4fdf6554c129280f5874eeabfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:05.418645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d26dc6f2-8cd8-4581-b5d3-5a0ab010b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:05.434295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69863eff-6624-4b53-901c-1b9f752f36d6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.533098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0ff39-6e2b-4522-af15-ebba31caabcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.533867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0ff39-6e2b-4522-af15-ebba31caabcb admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.534328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0ff39-6e2b-4522-af15-ebba31caabcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.534657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0ff39-6e2b-4522-af15-ebba31caabcb admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.535782 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0ff39-6e2b-4522-af15-ebba31caabcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.538621 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0ff39-6e2b-4522-af15-ebba31caabcb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.567272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 958/1926] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:05.568833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 969/1927] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:05 2022] POST /identity/v3/users => generated 291 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:05.569696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0ff39-6e2b-4522-af15-ebba31caabcb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.571913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26dc6f2-8cd8-4581-b5d3-5a0ab010b28a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.573342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d26dc6f2-8cd8-4581-b5d3-5a0ab010b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:05.582810 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0ff39-6e2b-4522-af15-ebba31caabcb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.590475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26dc6f2-8cd8-4581-b5d3-5a0ab010b28a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.595582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.596476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.596817 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.597104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] PATH_INFO: `/v3/projects/fa415831d8f6498a85258868dd1ce72c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.598454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa415831d8f6498a85258868dd1ce72c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.600951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.603516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bb1e8-2cbd-4880-908e-f3ec85342ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.604207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb1e8-2cbd-4880-908e-f3ec85342ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.604495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb1e8-2cbd-4880-908e-f3ec85342ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.604802 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb1e8-2cbd-4880-908e-f3ec85342ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.611701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bb1e8-2cbd-4880-908e-f3ec85342ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.624436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bb1e8-2cbd-4880-908e-f3ec85342ac8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.706623 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 970/1928] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:05 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:05.709394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa415831d8f6498a85258868dd1ce72c', 'request_id': 'req-b5f7ad20-187f-4db5-82e2-c66913ab893e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:05.716737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa415831d8f6498a85258868dd1ce72c', 'request_id': 'req-b5f7ad20-187f-4db5-82e2-c66913ab893e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:05.716942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bb1e8-2cbd-4880-908e-f3ec85342ac8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.723066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa415831d8f6498a85258868dd1ce72c', 'request_id': 'req-b5f7ad20-187f-4db5-82e2-c66913ab893e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:05.745358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] The token cache is being invalidate because project fa415831d8f6498a85258868dd1ce72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:05.745709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:05.746346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:05.749960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 959/1929] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:05 2022] DELETE /identity/v3/projects/fa415831d8f6498a85258868dd1ce72c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:05.750759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.753548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:05.791892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:05.827833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bb1e8-2cbd-4880-908e-f3ec85342ac8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.833779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0fcf-dfe2-4438-a5a5-db86b2b74326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.835179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0fcf-dfe2-4438-a5a5-db86b2b74326 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.835536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0fcf-dfe2-4438-a5a5-db86b2b74326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.836051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0fcf-dfe2-4438-a5a5-db86b2b74326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.836950 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0fcf-dfe2-4438-a5a5-db86b2b74326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.838731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0fcf-dfe2-4438-a5a5-db86b2b74326 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.840162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:05.853917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 971/1930] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:05.855367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386ddf-cb1b-458a-94de-fb1619ff1bb7 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.855688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386ddf-cb1b-458a-94de-fb1619ff1bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.855984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386ddf-cb1b-458a-94de-fb1619ff1bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.863568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7ad20-187f-4db5-82e2-c66913ab893e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.873369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068b3c3-5f2f-44c3-9567-03458e8e3e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.874797 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068b3c3-5f2f-44c3-9567-03458e8e3e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.875089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068b3c3-5f2f-44c3-9567-03458e8e3e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.875370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068b3c3-5f2f-44c3-9567-03458e8e3e29 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.877061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068b3c3-5f2f-44c3-9567-03458e8e3e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.879297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068b3c3-5f2f-44c3-9567-03458e8e3e29 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.881223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-82386ddf-cb1b-458a-94de-fb1619ff1bb7 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:05.882461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-82386ddf-cb1b-458a-94de-fb1619ff1bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:05.905272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 960/1931] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:05 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:05.906492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068b3c3-5f2f-44c3-9567-03458e8e3e29 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.908209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 972/1932] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:05.908813 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d068b3c3-5f2f-44c3-9567-03458e8e3e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:05.909184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82386ddf-cb1b-458a-94de-fb1619ff1bb7 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:05.910838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-82386ddf-cb1b-458a-94de-fb1619ff1bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:05.924262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82386ddf-cb1b-458a-94de-fb1619ff1bb7 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.932508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068b3c3-5f2f-44c3-9567-03458e8e3e29 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:05.936157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b6e98-ecae-4e37-9951-ca307ceda63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.936873 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b6e98-ecae-4e37-9951-ca307ceda63a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.937162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b6e98-ecae-4e37-9951-ca307ceda63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.937438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b6e98-ecae-4e37-9951-ca307ceda63a admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.938334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b6e98-ecae-4e37-9951-ca307ceda63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.939985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b6e98-ecae-4e37-9951-ca307ceda63a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:05.940692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:05.941826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.942323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.950362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] PATH_INFO: `/v3/users/345c2a49dece4409b98d5276eaa98f3f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.951916 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 973/1933] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:05.953552 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7b928-dcb6-4abb-a0b1-921b535b50b8 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:05.954040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7b928-dcb6-4abb-a0b1-921b535b50b8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:05.954506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7b928-dcb6-4abb-a0b1-921b535b50b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:05.954640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=345c2a49dece4409b98d5276eaa98f3f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:05.960305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:06.010965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-87a7b928-dcb6-4abb-a0b1-921b535b50b8 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:06.012258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-87a7b928-dcb6-4abb-a0b1-921b535b50b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:06.047968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 974/1934] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:06.055197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7b928-dcb6-4abb-a0b1-921b535b50b8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:06.089648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7b928-dcb6-4abb-a0b1-921b535b50b8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:06.108773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef67cdb-3c33-48bc-a020-89b0ae77b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:06.109468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef67cdb-3c33-48bc-a020-89b0ae77b5ab admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.109754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef67cdb-3c33-48bc-a020-89b0ae77b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.110299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef67cdb-3c33-48bc-a020-89b0ae77b5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.113935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef67cdb-3c33-48bc-a020-89b0ae77b5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:06.115689 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef67cdb-3c33-48bc-a020-89b0ae77b5ab admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:06.117510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345c2a49dece4409b98d5276eaa98f3f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:06.137889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345c2a49dece4409b98d5276eaa98f3f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:06.139995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345c2a49dece4409b98d5276eaa98f3f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:06.140683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345c2a49dece4409b98d5276eaa98f3f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:06.151042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 975/1935] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:06.151965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef67cdb-3c33-48bc-a020-89b0ae77b5ab admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:06.156204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-eef67cdb-3c33-48bc-a020-89b0ae77b5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:06.180394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345c2a49dece4409b98d5276eaa98f3f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:06.204759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef67cdb-3c33-48bc-a020-89b0ae77b5ab admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:06.212725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 961/1936] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:05 2022] DELETE /identity/v3/users/345c2a49dece4409b98d5276eaa98f3f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:06.214261 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:06.215647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:06.219351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10884104-ead5-4aa1-bd2e-156ffec703ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:06.220258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10884104-ead5-4aa1-bd2e-156ffec703ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.220539 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10884104-ead5-4aa1-bd2e-156ffec703ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.220900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10884104-ead5-4aa1-bd2e-156ffec703ca admin admin] PATH_INFO: `/v3/projects/2d0c90f713ca45d889407c2ad217fe3b/users/e960c833b6814f9f9622963325cb6a24/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.246973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10884104-ead5-4aa1-bd2e-156ffec703ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0c90f713ca45d889407c2ad217fe3b, user_id=e960c833b6814f9f9622963325cb6a24, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:06.254102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10884104-ead5-4aa1-bd2e-156ffec703ca admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:06.299057 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 976/1937] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:06 2022] PUT /identity/v3/projects/2d0c90f713ca45d889407c2ad217fe3b/users/e960c833b6814f9f9622963325cb6a24/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:06.300762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10884104-ead5-4aa1-bd2e-156ffec703ca admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:06.305163 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d584a-c04d-4751-b1cc-9aec50122a7b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:06.308588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-10884104-ead5-4aa1-bd2e-156ffec703ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:06.372940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e14075-3c99-43b7-bc0e-aec3891c99c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:06.374265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e14075-3c99-43b7-bc0e-aec3891c99c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.374722 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e14075-3c99-43b7-bc0e-aec3891c99c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.375159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e14075-3c99-43b7-bc0e-aec3891c99c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.376285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e14075-3c99-43b7-bc0e-aec3891c99c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:06.376784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e14075-3c99-43b7-bc0e-aec3891c99c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:06.378710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e14075-3c99-43b7-bc0e-aec3891c99c6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:06.381456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:06.397375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 962/1938] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:06.399336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849f17b-2363-4202-aad0-d7801a4d13fc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.399785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849f17b-2363-4202-aad0-d7801a4d13fc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.400224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849f17b-2363-4202-aad0-d7801a4d13fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.422158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8849f17b-2363-4202-aad0-d7801a4d13fc None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:06.423603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8849f17b-2363-4202-aad0-d7801a4d13fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:06.444476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 963/1939] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:06.445916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93150a2-2537-4fd5-83ea-8c5842df371e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.446320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93150a2-2537-4fd5-83ea-8c5842df371e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.446706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93150a2-2537-4fd5-83ea-8c5842df371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.488117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b93150a2-2537-4fd5-83ea-8c5842df371e None None] MFA Rules not processed for user `e960c833b6814f9f9622963325cb6a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:06.492600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10884104-ead5-4aa1-bd2e-156ffec703ca admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:06.499046 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872838f4-106d-4551-9731-f601553de4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:06.499614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b93150a2-2537-4fd5-83ea-8c5842df371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:06.500546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872838f4-106d-4551-9731-f601553de4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.500546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872838f4-106d-4551-9731-f601553de4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.500772 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872838f4-106d-4551-9731-f601553de4a5 admin admin] PATH_INFO: `/v3/projects/2cc0ee76b0844b2784135d16c27dc2f5/users/854fe20b6e0f44158d69f3921cb892ea/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.522291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872838f4-106d-4551-9731-f601553de4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc0ee76b0844b2784135d16c27dc2f5, user_id=854fe20b6e0f44158d69f3921cb892ea, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:06.525207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872838f4-106d-4551-9731-f601553de4a5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:06.547199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 977/1940] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:06 2022] PUT /identity/v3/projects/2cc0ee76b0844b2784135d16c27dc2f5/users/854fe20b6e0f44158d69f3921cb892ea/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:06.547199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872838f4-106d-4551-9731-f601553de4a5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:06.609877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 964/1941] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:06.610107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93150a2-2537-4fd5-83ea-8c5842df371e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:06.612672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b93150a2-2537-4fd5-83ea-8c5842df371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:06.684102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872838f4-106d-4551-9731-f601553de4a5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:06.699777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188d688-82ad-4198-9935-974332af9845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:06.700475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d688-82ad-4198-9935-974332af9845 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.700796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d688-82ad-4198-9935-974332af9845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.701077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d688-82ad-4198-9935-974332af9845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.702519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188d688-82ad-4198-9935-974332af9845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:06.703810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93150a2-2537-4fd5-83ea-8c5842df371e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:06.707656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188d688-82ad-4198-9935-974332af9845 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:06.728319 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:06.762208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 978/1942] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:06 2022] POST /identity/v3/projects => generated 401 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:06.763343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188d688-82ad-4198-9935-974332af9845 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:06.774091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c494563-8d41-40cd-ae32-5423bb91a57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:06.774894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c494563-8d41-40cd-ae32-5423bb91a57f service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.775251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c494563-8d41-40cd-ae32-5423bb91a57f service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.775603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c494563-8d41-40cd-ae32-5423bb91a57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.786056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c494563-8d41-40cd-ae32-5423bb91a57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:06.793613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c494563-8d41-40cd-ae32-5423bb91a57f service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:06.814629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 965/1943] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:06.815800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c494563-8d41-40cd-ae32-5423bb91a57f service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:06.838905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c494563-8d41-40cd-ae32-5423bb91a57f service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:06.860070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188d688-82ad-4198-9935-974332af9845 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:06.867665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ef926-ac25-4628-84b1-8862a0f04bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:06.868364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ef926-ac25-4628-84b1-8862a0f04bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.868677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ef926-ac25-4628-84b1-8862a0f04bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.868966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ef926-ac25-4628-84b1-8862a0f04bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.869712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ef926-ac25-4628-84b1-8862a0f04bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:06.871332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ef926-ac25-4628-84b1-8862a0f04bfb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:06.884478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 979/1944] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:06.885402 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ef926-ac25-4628-84b1-8862a0f04bfb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:06.898980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:06.899495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ef926-ac25-4628-84b1-8862a0f04bfb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:06.906036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35188fb-d095-4bc5-8da7-2aa10f3a170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:06.906832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35188fb-d095-4bc5-8da7-2aa10f3a170d admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.907125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35188fb-d095-4bc5-8da7-2aa10f3a170d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.907408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35188fb-d095-4bc5-8da7-2aa10f3a170d admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.908346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35188fb-d095-4bc5-8da7-2aa10f3a170d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:06.910929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35188fb-d095-4bc5-8da7-2aa10f3a170d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:06.952180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c84e7-ff18-4121-b372-eaa4da3e988a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:06.953032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c84e7-ff18-4121-b372-eaa4da3e988a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.954888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c84e7-ff18-4121-b372-eaa4da3e988a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.955316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c84e7-ff18-4121-b372-eaa4da3e988a admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.956200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c84e7-ff18-4121-b372-eaa4da3e988a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:06.961510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c84e7-ff18-4121-b372-eaa4da3e988a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:06.963374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 980/1945] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:06 2022] POST /identity/v3/users => generated 301 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:06.965860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35188fb-d095-4bc5-8da7-2aa10f3a170d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:06.984044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35188fb-d095-4bc5-8da7-2aa10f3a170d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:06.991450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed8e14-d486-4315-a0e0-25557195d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:06.993969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed8e14-d486-4315-a0e0-25557195d800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.994983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed8e14-d486-4315-a0e0-25557195d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.995642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed8e14-d486-4315-a0e0-25557195d800 admin admin] PATH_INFO: `/v3/projects/2cc0ee76b0844b2784135d16c27dc2f5/users/854fe20b6e0f44158d69f3921cb892ea/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.998705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed8e14-d486-4315-a0e0-25557195d800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc0ee76b0844b2784135d16c27dc2f5, user_id=854fe20b6e0f44158d69f3921cb892ea, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:07.001989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed8e14-d486-4315-a0e0-25557195d800 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:07.028004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 966/1946] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:06 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:07.029428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c84e7-ff18-4121-b372-eaa4da3e988a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.041807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 981/1947] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:06 2022] PUT /identity/v3/projects/2cc0ee76b0844b2784135d16c27dc2f5/users/854fe20b6e0f44158d69f3921cb892ea/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:07.047597 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed8e14-d486-4315-a0e0-25557195d800 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.166117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c84e7-ff18-4121-b372-eaa4da3e988a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:07.174550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701a237-faac-410e-a9ad-19c3b7f68a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:07.175437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701a237-faac-410e-a9ad-19c3b7f68a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.175783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701a237-faac-410e-a9ad-19c3b7f68a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.176193 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701a237-faac-410e-a9ad-19c3b7f68a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.178683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701a237-faac-410e-a9ad-19c3b7f68a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:07.183242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701a237-faac-410e-a9ad-19c3b7f68a59 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:07.194856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed8e14-d486-4315-a0e0-25557195d800 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:07.202686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 967/1948] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:07.204657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e7bb2-498c-44c7-a0b4-1293dbe8d93d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.204657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e7bb2-498c-44c7-a0b4-1293dbe8d93d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.204657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e7bb2-498c-44c7-a0b4-1293dbe8d93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.207832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603cd08-20c0-4b40-b409-f6fed92b6032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:07.209276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603cd08-20c0-4b40-b409-f6fed92b6032 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.209561 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603cd08-20c0-4b40-b409-f6fed92b6032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.209878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603cd08-20c0-4b40-b409-f6fed92b6032 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.210585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603cd08-20c0-4b40-b409-f6fed92b6032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:07.216217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603cd08-20c0-4b40-b409-f6fed92b6032 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:07.253503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 982/1949] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:07 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:07.254088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603cd08-20c0-4b40-b409-f6fed92b6032 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.284533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603cd08-20c0-4b40-b409-f6fed92b6032 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:07.291537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd26d-b0d5-49c1-bdea-318cf2153398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:07.292788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd26d-b0d5-49c1-bdea-318cf2153398 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.292788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd26d-b0d5-49c1-bdea-318cf2153398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.292979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd26d-b0d5-49c1-bdea-318cf2153398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.293669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd26d-b0d5-49c1-bdea-318cf2153398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:07.295335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd26d-b0d5-49c1-bdea-318cf2153398 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:07.296272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3e2e7bb2-498c-44c7-a0b4-1293dbe8d93d None None] MFA Rules not processed for user `854fe20b6e0f44158d69f3921cb892ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:07.314783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3e2e7bb2-498c-44c7-a0b4-1293dbe8d93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:07.321240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 983/1950] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:07.322325 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd26d-b0d5-49c1-bdea-318cf2153398 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.352162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd26d-b0d5-49c1-bdea-318cf2153398 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:07.357241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c6142-355a-408a-8cc2-fd6607adc299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:07.357931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c6142-355a-408a-8cc2-fd6607adc299 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.358218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c6142-355a-408a-8cc2-fd6607adc299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.358495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c6142-355a-408a-8cc2-fd6607adc299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.372770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c6142-355a-408a-8cc2-fd6607adc299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:07.374811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c6142-355a-408a-8cc2-fd6607adc299 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:07.389650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 984/1951] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:07.389650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c6142-355a-408a-8cc2-fd6607adc299 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.411119 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c6142-355a-408a-8cc2-fd6607adc299 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:07.425413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e57fd2-ece5-466e-9529-b3a4cd3c7d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:07.426352 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e57fd2-ece5-466e-9529-b3a4cd3c7d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.426674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e57fd2-ece5-466e-9529-b3a4cd3c7d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.426984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e57fd2-ece5-466e-9529-b3a4cd3c7d5a admin admin] PATH_INFO: `/v3/projects/9bcf78a29e994c0398db2fd73955da63/users/8cc4cf810b2c44be9674cce10763915e/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.465576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e57fd2-ece5-466e-9529-b3a4cd3c7d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bcf78a29e994c0398db2fd73955da63, user_id=8cc4cf810b2c44be9674cce10763915e, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:07.468883 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e57fd2-ece5-466e-9529-b3a4cd3c7d5a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:07.481089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:07.497107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 985/1952] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:07 2022] PUT /identity/v3/projects/9bcf78a29e994c0398db2fd73955da63/users/8cc4cf810b2c44be9674cce10763915e/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:07.498438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e57fd2-ece5-466e-9529-b3a4cd3c7d5a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.519316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 968/1953] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:07.522359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246ef66-4090-4ebd-a908-e18b3c7baeb5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.523670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246ef66-4090-4ebd-a908-e18b3c7baeb5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.523965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246ef66-4090-4ebd-a908-e18b3c7baeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.601466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e57fd2-ece5-466e-9529-b3a4cd3c7d5a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:07.607365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339c5f0-de27-46eb-ba21-222dc6083c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:07.608804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339c5f0-de27-46eb-ba21-222dc6083c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.609096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339c5f0-de27-46eb-ba21-222dc6083c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.609200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b246ef66-4090-4ebd-a908-e18b3c7baeb5 None None] MFA Rules not processed for user `8cc4cf810b2c44be9674cce10763915e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:07.609372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339c5f0-de27-46eb-ba21-222dc6083c92 admin admin] PATH_INFO: `/v3/projects/fa0e0614bbc944299e2eea180640db06/users/9dc44341a89944cf8f466c783ec233f7/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.611889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b246ef66-4090-4ebd-a908-e18b3c7baeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:07.633491 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339c5f0-de27-46eb-ba21-222dc6083c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0e0614bbc944299e2eea180640db06, user_id=9dc44341a89944cf8f466c783ec233f7, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:07.637547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339c5f0-de27-46eb-ba21-222dc6083c92 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:07.652269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:07.663910 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 986/1954] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:07 2022] PUT /identity/v3/projects/fa0e0614bbc944299e2eea180640db06/users/9dc44341a89944cf8f466c783ec233f7/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:07.665010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339c5f0-de27-46eb-ba21-222dc6083c92 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.667616 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5339c5f0-de27-46eb-ba21-222dc6083c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:07.698904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 969/1955] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:07.699946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246ef66-4090-4ebd-a908-e18b3c7baeb5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.721837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246ef66-4090-4ebd-a908-e18b3c7baeb5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:07.754856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339c5f0-de27-46eb-ba21-222dc6083c92 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:07.760659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35395211-56f0-4d2c-b272-8b7fcd8aa9bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:07.760659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35395211-56f0-4d2c-b272-8b7fcd8aa9bb service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.760659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35395211-56f0-4d2c-b272-8b7fcd8aa9bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.760659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35395211-56f0-4d2c-b272-8b7fcd8aa9bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.819329 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0eb167-86ed-47af-936f-aaadd920199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:07.820113 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb167-86ed-47af-936f-aaadd920199f admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.820406 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb167-86ed-47af-936f-aaadd920199f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.820727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb167-86ed-47af-936f-aaadd920199f admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.821548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0eb167-86ed-47af-936f-aaadd920199f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:07.823171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0eb167-86ed-47af-936f-aaadd920199f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:07.833289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 970/1956] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:07.834090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0eb167-86ed-47af-936f-aaadd920199f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.837610 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35395211-56f0-4d2c-b272-8b7fcd8aa9bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:07.840067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35395211-56f0-4d2c-b272-8b7fcd8aa9bb service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:07.845193 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0eb167-86ed-47af-936f-aaadd920199f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:07.853186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba52ee4-de56-4858-b2aa-f375f7ed4522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:07.853859 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba52ee4-de56-4858-b2aa-f375f7ed4522 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.854150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba52ee4-de56-4858-b2aa-f375f7ed4522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.854435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba52ee4-de56-4858-b2aa-f375f7ed4522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.855198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba52ee4-de56-4858-b2aa-f375f7ed4522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:07.857426 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba52ee4-de56-4858-b2aa-f375f7ed4522 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:07.866818 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 987/1957] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:07.867783 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35395211-56f0-4d2c-b272-8b7fcd8aa9bb service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.885891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35395211-56f0-4d2c-b272-8b7fcd8aa9bb service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:07.892902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27d018-f650-48dc-87c5-dc688de2d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:07.894122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27d018-f650-48dc-87c5-dc688de2d146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:07.894316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 971/1958] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:07 2022] POST /identity/v3/projects => generated 401 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:07.894581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27d018-f650-48dc-87c5-dc688de2d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:07.894868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27d018-f650-48dc-87c5-dc688de2d146 admin admin] PATH_INFO: `/v3/projects/fa0e0614bbc944299e2eea180640db06/users/9dc44341a89944cf8f466c783ec233f7/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:07.898014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27d018-f650-48dc-87c5-dc688de2d146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0e0614bbc944299e2eea180640db06, user_id=9dc44341a89944cf8f466c783ec233f7, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:07.900066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba52ee4-de56-4858-b2aa-f375f7ed4522 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.901242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27d018-f650-48dc-87c5-dc688de2d146 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:07.918267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 988/1959] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:07 2022] PUT /identity/v3/projects/fa0e0614bbc944299e2eea180640db06/users/9dc44341a89944cf8f466c783ec233f7/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:07.930126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27d018-f650-48dc-87c5-dc688de2d146 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:07.936968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-de27d018-f650-48dc-87c5-dc688de2d146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:07.970654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:08.016260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba52ee4-de56-4858-b2aa-f375f7ed4522 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.044100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27d018-f650-48dc-87c5-dc688de2d146 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.049747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.051391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.051685 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.051963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] PATH_INFO: `/v3/projects/0edf24e521d94240b9792adcb3e6f9e9` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.054091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0edf24e521d94240b9792adcb3e6f9e9)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.057130 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.079873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:08.099632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbd224-d3d4-4dc5-b04d-3c9f1890456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.100468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbd224-d3d4-4dc5-b04d-3c9f1890456d admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.100978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbd224-d3d4-4dc5-b04d-3c9f1890456d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.101381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbd224-d3d4-4dc5-b04d-3c9f1890456d admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.102805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbd224-d3d4-4dc5-b04d-3c9f1890456d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.119193 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbd224-d3d4-4dc5-b04d-3c9f1890456d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.158755 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0edf24e521d94240b9792adcb3e6f9e9', 'request_id': 'req-82dcd77e-2b9f-47a0-926b-b732473eed19'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.167664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0edf24e521d94240b9792adcb3e6f9e9', 'request_id': 'req-82dcd77e-2b9f-47a0-926b-b732473eed19'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.171607 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 972/1960] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:07 2022] POST /identity/v3/users => generated 307 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:08.173524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375ebc5-7474-4eee-9ae6-8acf8b9877aa None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.173524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375ebc5-7474-4eee-9ae6-8acf8b9877aa None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.173524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375ebc5-7474-4eee-9ae6-8acf8b9877aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.179705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0edf24e521d94240b9792adcb3e6f9e9', 'request_id': 'req-82dcd77e-2b9f-47a0-926b-b732473eed19'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.199613 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] The token cache is being invalidate because project 0edf24e521d94240b9792adcb3e6f9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:08.199911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.200680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.205963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 989/1961] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:07 2022] DELETE /identity/v3/projects/0edf24e521d94240b9792adcb3e6f9e9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:08.209518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:08.211535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.217152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0375ebc5-7474-4eee-9ae6-8acf8b9877aa None None] MFA Rules not processed for user `9dc44341a89944cf8f466c783ec233f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:08.218220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0375ebc5-7474-4eee-9ae6-8acf8b9877aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.312986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcd77e-2b9f-47a0-926b-b732473eed19 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.320268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 973/1962] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:08.320268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375ebc5-7474-4eee-9ae6-8acf8b9877aa None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:08.320268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0375ebc5-7474-4eee-9ae6-8acf8b9877aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.333359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fc242-5005-4923-9d9b-cf9ce700443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.333359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fc242-5005-4923-9d9b-cf9ce700443c admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.333359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fc242-5005-4923-9d9b-cf9ce700443c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.333359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fc242-5005-4923-9d9b-cf9ce700443c admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.334285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fc242-5005-4923-9d9b-cf9ce700443c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.335337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fc242-5005-4923-9d9b-cf9ce700443c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.337400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375ebc5-7474-4eee-9ae6-8acf8b9877aa None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.342989 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.343878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.344171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.344452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] PATH_INFO: `/v3/users/203a27138ac94c1194ae385b4dc1f5f1` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.345743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=203a27138ac94c1194ae385b4dc1f5f1)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.346801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 990/1963] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:08.347708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.347819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fc242-5005-4923-9d9b-cf9ce700443c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:08.349904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-010fc242-5005-4923-9d9b-cf9ce700443c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.398935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:08.406164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '203a27138ac94c1194ae385b4dc1f5f1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.413899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fc242-5005-4923-9d9b-cf9ce700443c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.417560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '203a27138ac94c1194ae385b4dc1f5f1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.418007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8b5f7-22e1-4dd2-a2f0-c0b194f6fa75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.418231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '203a27138ac94c1194ae385b4dc1f5f1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.418659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8b5f7-22e1-4dd2-a2f0-c0b194f6fa75 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.418949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8b5f7-22e1-4dd2-a2f0-c0b194f6fa75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.419164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '203a27138ac94c1194ae385b4dc1f5f1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.419263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8b5f7-22e1-4dd2-a2f0-c0b194f6fa75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.421721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1aa8b5f7-22e1-4dd2-a2f0-c0b194f6fa75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.434410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '203a27138ac94c1194ae385b4dc1f5f1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:08.435907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8b5f7-22e1-4dd2-a2f0-c0b194f6fa75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.437600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8b5f7-22e1-4dd2-a2f0-c0b194f6fa75 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.448654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 991/1964] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:08.449636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8b5f7-22e1-4dd2-a2f0-c0b194f6fa75 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:08.450612 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1aa8b5f7-22e1-4dd2-a2f0-c0b194f6fa75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.451734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 974/1965] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:08 2022] DELETE /identity/v3/users/203a27138ac94c1194ae385b4dc1f5f1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:08.452852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:08.455907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.518948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:08.558613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f7451-86a8-446a-86e1-c5f1fbce1bb1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.564004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f9fe3-80f2-4a10-b35a-95860148aaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.565077 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f9fe3-80f2-4a10-b35a-95860148aaaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.565284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f9fe3-80f2-4a10-b35a-95860148aaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.565579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f9fe3-80f2-4a10-b35a-95860148aaaf admin admin] PATH_INFO: `/v3/projects/29231d0d423d4d9c990d6d58f2afacfe/users/29f075b1613e4123bb3c15cf801093e9/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.579283 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8b5f7-22e1-4dd2-a2f0-c0b194f6fa75 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.585465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f9fe3-80f2-4a10-b35a-95860148aaaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=29231d0d423d4d9c990d6d58f2afacfe, user_id=29f075b1613e4123bb3c15cf801093e9, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.588320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f9fe3-80f2-4a10-b35a-95860148aaaf admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.609294 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 975/1966] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:08 2022] PUT /identity/v3/projects/29231d0d423d4d9c990d6d58f2afacfe/users/29f075b1613e4123bb3c15cf801093e9/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:08.611144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f9fe3-80f2-4a10-b35a-95860148aaaf admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:08.613576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ae7f9fe3-80f2-4a10-b35a-95860148aaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.653943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ea23d-cf0c-4e2f-ab7f-abdc38fab970 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854fe20b6e0f44158d69f3921cb892ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cc0ee76b0844b2784135d16c27dc2f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.654755 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ea23d-cf0c-4e2f-ab7f-abdc38fab970 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.655120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ea23d-cf0c-4e2f-ab7f-abdc38fab970 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.655479 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ea23d-cf0c-4e2f-ab7f-abdc38fab970 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.656323 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ea23d-cf0c-4e2f-ab7f-abdc38fab970 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:08.656762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ea23d-cf0c-4e2f-ab7f-abdc38fab970 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.658468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ea23d-cf0c-4e2f-ab7f-abdc38fab970 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.674322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 992/1967] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:08.674322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ea23d-cf0c-4e2f-ab7f-abdc38fab970 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:08.684565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ea23d-cf0c-4e2f-ab7f-abdc38fab970 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.697170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f9fe3-80f2-4a10-b35a-95860148aaaf admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.700894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87de40-4451-4cd2-b0cc-db94163486ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.701546 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87de40-4451-4cd2-b0cc-db94163486ab service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.701832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87de40-4451-4cd2-b0cc-db94163486ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.702105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87de40-4451-4cd2-b0cc-db94163486ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.704089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5b87de40-4451-4cd2-b0cc-db94163486ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.752711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bf77d-b0a0-44e7-badf-3d0a0c7aa66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.753487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bf77d-b0a0-44e7-badf-3d0a0c7aa66f admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.753851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bf77d-b0a0-44e7-badf-3d0a0c7aa66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.754196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bf77d-b0a0-44e7-badf-3d0a0c7aa66f admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.754993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bf77d-b0a0-44e7-badf-3d0a0c7aa66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.757638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bf77d-b0a0-44e7-badf-3d0a0c7aa66f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.769490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 993/1968] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:08.770394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bf77d-b0a0-44e7-badf-3d0a0c7aa66f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:08.804083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:08.807534 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87de40-4451-4cd2-b0cc-db94163486ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.809126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87de40-4451-4cd2-b0cc-db94163486ab service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.820578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 976/1969] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:08.821506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87de40-4451-4cd2-b0cc-db94163486ab service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:08.835122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87de40-4451-4cd2-b0cc-db94163486ab service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.853471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797611d-4f4f-4aeb-87dc-68ebc3b3452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.855408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797611d-4f4f-4aeb-87dc-68ebc3b3452b admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.855757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797611d-4f4f-4aeb-87dc-68ebc3b3452b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.856047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797611d-4f4f-4aeb-87dc-68ebc3b3452b admin admin] PATH_INFO: `/v3/projects/29231d0d423d4d9c990d6d58f2afacfe/users/29f075b1613e4123bb3c15cf801093e9/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.857156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bf77d-b0a0-44e7-badf-3d0a0c7aa66f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:08.858301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797611d-4f4f-4aeb-87dc-68ebc3b3452b admin admin] RBAC: Authorizing `identity:create_grant(project_id=29231d0d423d4d9c990d6d58f2afacfe, user_id=29f075b1613e4123bb3c15cf801093e9, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.861176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797611d-4f4f-4aeb-87dc-68ebc3b3452b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.863081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b70243-356f-47db-a2a0-197b941e0563 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854fe20b6e0f44158d69f3921cb892ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cc0ee76b0844b2784135d16c27dc2f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:08.863941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b70243-356f-47db-a2a0-197b941e0563 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.864333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b70243-356f-47db-a2a0-197b941e0563 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.865391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b70243-356f-47db-a2a0-197b941e0563 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.866214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b70243-356f-47db-a2a0-197b941e0563 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:08.868241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b70243-356f-47db-a2a0-197b941e0563 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:08.876713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 977/1970] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:08 2022] PUT /identity/v3/projects/29231d0d423d4d9c990d6d58f2afacfe/users/29f075b1613e4123bb3c15cf801093e9/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:08.886040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf558076-5aab-4512-b90a-ac15f2c566aa None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:08.886372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf558076-5aab-4512-b90a-ac15f2c566aa None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:08.886662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf558076-5aab-4512-b90a-ac15f2c566aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:08.921862 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-cf558076-5aab-4512-b90a-ac15f2c566aa None None] MFA Rules not processed for user `29f075b1613e4123bb3c15cf801093e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:08.923176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cf558076-5aab-4512-b90a-ac15f2c566aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:08.927178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 994/1971] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:08 2022] POST /identity/v3/projects => generated 354 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:08.928948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b70243-356f-47db-a2a0-197b941e0563 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.018013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b70243-356f-47db-a2a0-197b941e0563 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.026065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850d9cf-9257-44ee-99f6-37cf7dbfacd4 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854fe20b6e0f44158d69f3921cb892ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cc0ee76b0844b2784135d16c27dc2f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.027483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850d9cf-9257-44ee-99f6-37cf7dbfacd4 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.027993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850d9cf-9257-44ee-99f6-37cf7dbfacd4 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.028449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850d9cf-9257-44ee-99f6-37cf7dbfacd4 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.030082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850d9cf-9257-44ee-99f6-37cf7dbfacd4 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:09.030523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850d9cf-9257-44ee-99f6-37cf7dbfacd4 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.033415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850d9cf-9257-44ee-99f6-37cf7dbfacd4 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.044469 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:09.064716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 995/1972] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:09.073942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850d9cf-9257-44ee-99f6-37cf7dbfacd4 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.076293 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2850d9cf-9257-44ee-99f6-37cf7dbfacd4 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.108845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 978/1973] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:09.144934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf558076-5aab-4512-b90a-ac15f2c566aa None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.166849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf558076-5aab-4512-b90a-ac15f2c566aa None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.174331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854fe20b6e0f44158d69f3921cb892ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cc0ee76b0844b2784135d16c27dc2f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.175444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.175737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.176018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] PATH_INFO: `/v3/projects/943e389c1d504fa39f330692b05733fb` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.177868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=943e389c1d504fa39f330692b05733fb)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.180521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.219699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850d9cf-9257-44ee-99f6-37cf7dbfacd4 tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.227275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.228154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.228508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.228777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] PATH_INFO: `/v3/projects/57537fa4eda142368b8c81d0376c23a2` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.230089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57537fa4eda142368b8c81d0376c23a2)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.232846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.243959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943e389c1d504fa39f330692b05733fb', 'request_id': 'req-30c9d675-7221-4e42-af9e-1ad3b0896c3e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.252535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943e389c1d504fa39f330692b05733fb', 'request_id': 'req-30c9d675-7221-4e42-af9e-1ad3b0896c3e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.265186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943e389c1d504fa39f330692b05733fb', 'request_id': 'req-30c9d675-7221-4e42-af9e-1ad3b0896c3e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.285155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] The token cache is being invalidate because project 943e389c1d504fa39f330692b05733fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:09.286301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.288020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.289935 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 979/1974] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:09 2022] DELETE /identity/v3/projects/943e389c1d504fa39f330692b05733fb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:09.291677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.293293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.332175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:09.341777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57537fa4eda142368b8c81d0376c23a2', 'request_id': 'req-67f4b75a-70d7-44f3-af5f-b6125663f9b0'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.353231 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57537fa4eda142368b8c81d0376c23a2', 'request_id': 'req-67f4b75a-70d7-44f3-af5f-b6125663f9b0'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.376658 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57537fa4eda142368b8c81d0376c23a2', 'request_id': 'req-67f4b75a-70d7-44f3-af5f-b6125663f9b0'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.401606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] The token cache is being invalidate because project 57537fa4eda142368b8c81d0376c23a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:09.404275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.404513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9d675-7221-4e42-af9e-1ad3b0896c3e tempest-VolumeQuotaClassesTest-1374899596 tempest-VolumeQuotaClassesTest-1374899596-project-admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.405553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-67f4b75a-70d7-44f3-af5f-b6125663f9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.409181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 996/1975] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:09 2022] DELETE /identity/v3/projects/57537fa4eda142368b8c81d0376c23a2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:09.417464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313286-7555-4a95-a3fb-649a1e910ca4 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.417763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313286-7555-4a95-a3fb-649a1e910ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.418056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313286-7555-4a95-a3fb-649a1e910ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.458280 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5c313286-7555-4a95-a3fb-649a1e910ca4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:09.458280 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5c313286-7555-4a95-a3fb-649a1e910ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.507051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884589e3-f273-4d56-8b27-94ed41338556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.507051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884589e3-f273-4d56-8b27-94ed41338556 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.507051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884589e3-f273-4d56-8b27-94ed41338556 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.507051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884589e3-f273-4d56-8b27-94ed41338556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.508869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-884589e3-f273-4d56-8b27-94ed41338556 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.534828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 997/1976] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:09.543116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d2db-bf0e-4cd1-86fd-05c62764c651 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.543404 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d2db-bf0e-4cd1-86fd-05c62764c651 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.543690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d2db-bf0e-4cd1-86fd-05c62764c651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.563632 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ad86d2db-bf0e-4cd1-86fd-05c62764c651 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:09.564930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ad86d2db-bf0e-4cd1-86fd-05c62764c651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.572021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:09.577671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 998/1977] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:09.581925 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86d2db-bf0e-4cd1-86fd-05c62764c651 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.593179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86d2db-bf0e-4cd1-86fd-05c62764c651 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.601468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884589e3-f273-4d56-8b27-94ed41338556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.602638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aea4a-b19c-4763-a6ef-b0a5f0bb04a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.602921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884589e3-f273-4d56-8b27-94ed41338556 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.603356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aea4a-b19c-4763-a6ef-b0a5f0bb04a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.603645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aea4a-b19c-4763-a6ef-b0a5f0bb04a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.603956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aea4a-b19c-4763-a6ef-b0a5f0bb04a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.604722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aea4a-b19c-4763-a6ef-b0a5f0bb04a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:09.605039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aea4a-b19c-4763-a6ef-b0a5f0bb04a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.607162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aea4a-b19c-4763-a6ef-b0a5f0bb04a2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.615964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 980/1978] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:09 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:09.620651 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 999/1979] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:14:09.624466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aea4a-b19c-4763-a6ef-b0a5f0bb04a2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.627608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884589e3-f273-4d56-8b27-94ed41338556 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.630012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-884589e3-f273-4d56-8b27-94ed41338556 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.635449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aea4a-b19c-4763-a6ef-b0a5f0bb04a2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.642444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b464c-5714-4723-b708-231ad88a4315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.643168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b464c-5714-4723-b708-231ad88a4315 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.643457 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b464c-5714-4723-b708-231ad88a4315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.643733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b464c-5714-4723-b708-231ad88a4315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.644435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b464c-5714-4723-b708-231ad88a4315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.646664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b464c-5714-4723-b708-231ad88a4315 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.659097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884589e3-f273-4d56-8b27-94ed41338556 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.678550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.679454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.679990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.680270 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] PATH_INFO: `/v3/users/b516b4fdf6554c129280f5874eeabfae` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.682051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b516b4fdf6554c129280f5874eeabfae)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.684464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.691531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1000/1980] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:09 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:09.692416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b464c-5714-4723-b708-231ad88a4315 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.743378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b516b4fdf6554c129280f5874eeabfae'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.750995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b516b4fdf6554c129280f5874eeabfae'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.751751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b516b4fdf6554c129280f5874eeabfae'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.752447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b516b4fdf6554c129280f5874eeabfae'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.765882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b516b4fdf6554c129280f5874eeabfae'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:09.772927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b464c-5714-4723-b708-231ad88a4315 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.778088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89797b2f-8522-4743-8e6b-60a48eb6e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.778769 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89797b2f-8522-4743-8e6b-60a48eb6e5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.779056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89797b2f-8522-4743-8e6b-60a48eb6e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.779341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89797b2f-8522-4743-8e6b-60a48eb6e5d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.780016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 981/1981] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:09 2022] DELETE /identity/v3/users/b516b4fdf6554c129280f5874eeabfae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:09.780165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89797b2f-8522-4743-8e6b-60a48eb6e5d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.780865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.782213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.782355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89797b2f-8522-4743-8e6b-60a48eb6e5d5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.804091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1001/1982] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:09 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:09.805416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26e0bc-8766-428d-a510-2c21491cab56 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.805706 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26e0bc-8766-428d-a510-2c21491cab56 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.805984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26e0bc-8766-428d-a510-2c21491cab56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.823241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ac26e0bc-8766-428d-a510-2c21491cab56 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:09.824434 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ac26e0bc-8766-428d-a510-2c21491cab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.841073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:09.842956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f291877-cccf-41c9-83ca-f2ab673559eb admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.847323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf787175-26f5-4024-a96b-4045adc20194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.847902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf787175-26f5-4024-a96b-4045adc20194 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.848187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf787175-26f5-4024-a96b-4045adc20194 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.848468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf787175-26f5-4024-a96b-4045adc20194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.850897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cf787175-26f5-4024-a96b-4045adc20194 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.892733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1002/1983] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:09.893915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26e0bc-8766-428d-a510-2c21491cab56 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.896876 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ac26e0bc-8766-428d-a510-2c21491cab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.909351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26e0bc-8766-428d-a510-2c21491cab56 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.915890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5965db-440b-447e-b2fa-a48c4ebcd79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.916601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5965db-440b-447e-b2fa-a48c4ebcd79c admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.916935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5965db-440b-447e-b2fa-a48c4ebcd79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.917221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5965db-440b-447e-b2fa-a48c4ebcd79c admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.917965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5965db-440b-447e-b2fa-a48c4ebcd79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.919673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5965db-440b-447e-b2fa-a48c4ebcd79c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.928508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf787175-26f5-4024-a96b-4045adc20194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.930166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf787175-26f5-4024-a96b-4045adc20194 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.937365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1003/1984] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:09.938264 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5965db-440b-447e-b2fa-a48c4ebcd79c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.940135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-dd5965db-440b-447e-b2fa-a48c4ebcd79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:09.940270 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 982/1985] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:09.940887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf787175-26f5-4024-a96b-4045adc20194 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:09.947766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:09.955299 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf787175-26f5-4024-a96b-4045adc20194 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:09.965142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323ef5e-61e4-4b6c-ad5c-1bc1bdbc217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:09.966155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323ef5e-61e4-4b6c-ad5c-1bc1bdbc217e admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:09.966520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323ef5e-61e4-4b6c-ad5c-1bc1bdbc217e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:09.966868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323ef5e-61e4-4b6c-ad5c-1bc1bdbc217e admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:09.967875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323ef5e-61e4-4b6c-ad5c-1bc1bdbc217e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:09.969931 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323ef5e-61e4-4b6c-ad5c-1bc1bdbc217e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:09.990452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 983/1986] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:09.991454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323ef5e-61e4-4b6c-ad5c-1bc1bdbc217e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.005531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323ef5e-61e4-4b6c-ad5c-1bc1bdbc217e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.012305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93cb4f-5c7f-450b-8d98-5781814005bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.013472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93cb4f-5c7f-450b-8d98-5781814005bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.013978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93cb4f-5c7f-450b-8d98-5781814005bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.014397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93cb4f-5c7f-450b-8d98-5781814005bd admin admin] PATH_INFO: `/v3/projects/55504664ef8549fd82a7c3d6d399d6b6/users/8f625c0a37324e2d996676563cb128b9/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.035091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93cb4f-5c7f-450b-8d98-5781814005bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=55504664ef8549fd82a7c3d6d399d6b6, user_id=8f625c0a37324e2d996676563cb128b9, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.039137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93cb4f-5c7f-450b-8d98-5781814005bd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.063134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 984/1987] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:09 2022] PUT /identity/v3/projects/55504664ef8549fd82a7c3d6d399d6b6/users/8f625c0a37324e2d996676563cb128b9/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:10.064712 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c37820-d2a1-4adb-867f-0b493c10c0e4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.065027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c37820-d2a1-4adb-867f-0b493c10c0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.065434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c37820-d2a1-4adb-867f-0b493c10c0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.080895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5965db-440b-447e-b2fa-a48c4ebcd79c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.088982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-60c37820-d2a1-4adb-867f-0b493c10c0e4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:10.091296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-60c37820-d2a1-4adb-867f-0b493c10c0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:10.194107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2f32e-e55e-45f9-8980-21507d3c6a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.195682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f32e-e55e-45f9-8980-21507d3c6a04 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.196168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f32e-e55e-45f9-8980-21507d3c6a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.196501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f32e-e55e-45f9-8980-21507d3c6a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.216736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 985/1988] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:10.227802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c37820-d2a1-4adb-867f-0b493c10c0e4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.230265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-60c37820-d2a1-4adb-867f-0b493c10c0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:10.253365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c37820-d2a1-4adb-867f-0b493c10c0e4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.257715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5a177-99f0-4a8e-8a43-ddf53ed612f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.258512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a177-99f0-4a8e-8a43-ddf53ed612f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.258735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a177-99f0-4a8e-8a43-ddf53ed612f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.259065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a177-99f0-4a8e-8a43-ddf53ed612f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.270498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5a177-99f0-4a8e-8a43-ddf53ed612f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.272852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5a177-99f0-4a8e-8a43-ddf53ed612f8 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.283908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 986/1989] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:10.317786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2f32e-e55e-45f9-8980-21507d3c6a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.319605 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2f32e-e55e-45f9-8980-21507d3c6a04 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.346715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1004/1990] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:10.795311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5a177-99f0-4a8e-8a43-ddf53ed612f8 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.797419 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b6e5a177-99f0-4a8e-8a43-ddf53ed612f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:10.813034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5a177-99f0-4a8e-8a43-ddf53ed612f8 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.820659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.821852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.822537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.822860 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] PATH_INFO: `/v3/projects/1fc98b4c4088461d8e7ef355f3dcf215` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.824795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc98b4c4088461d8e7ef355f3dcf215)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.827500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.884146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc98b4c4088461d8e7ef355f3dcf215', 'request_id': 'req-4101385b-8a46-4dac-827d-6db6f066f678'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.891243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc98b4c4088461d8e7ef355f3dcf215', 'request_id': 'req-4101385b-8a46-4dac-827d-6db6f066f678'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.898279 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc98b4c4088461d8e7ef355f3dcf215', 'request_id': 'req-4101385b-8a46-4dac-827d-6db6f066f678'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.913769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] The token cache is being invalidate because project 1fc98b4c4088461d8e7ef355f3dcf215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:10.914064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.914715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4101385b-8a46-4dac-827d-6db6f066f678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.916300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 987/1991] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:10 2022] DELETE /identity/v3/projects/1fc98b4c4088461d8e7ef355f3dcf215 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:10.920393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2f32e-e55e-45f9-8980-21507d3c6a04 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.930330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2f32e-e55e-45f9-8980-21507d3c6a04 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.942904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:10.998077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.998967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.999250 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.999526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] PATH_INFO: `/v3/users/854fe20b6e0f44158d69f3921cb892ea` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.000749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] RBAC: Authorizing `identity:delete_user(user_id=854fe20b6e0f44158d69f3921cb892ea)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.003843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.058862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854fe20b6e0f44158d69f3921cb892ea'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.069776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854fe20b6e0f44158d69f3921cb892ea'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.069776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854fe20b6e0f44158d69f3921cb892ea'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.070162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854fe20b6e0f44158d69f3921cb892ea'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.094476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854fe20b6e0f44158d69f3921cb892ea'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.113637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1005/1992] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:10 2022] DELETE /identity/v3/users/854fe20b6e0f44158d69f3921cb892ea => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:11.185127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e5775-ffe2-40f6-ad0c-1613fd70eff4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.185510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e5775-ffe2-40f6-ad0c-1613fd70eff4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.186800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e5775-ffe2-40f6-ad0c-1613fd70eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.222569 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-260e5775-ffe2-40f6-ad0c-1613fd70eff4 None None] MFA Rules not processed for user `8f625c0a37324e2d996676563cb128b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:11.225616 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-260e5775-ffe2-40f6-ad0c-1613fd70eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.265419 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:11.319823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 988/1993] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:11.330222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.337895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.476370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04ef06-b071-4329-b5e1-f3bf9d39423f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.497801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1f4c-c01a-49fd-b6f4-7b148986b87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.498010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1f4c-c01a-49fd-b6f4-7b148986b87c admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.498336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1f4c-c01a-49fd-b6f4-7b148986b87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.498597 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1f4c-c01a-49fd-b6f4-7b148986b87c admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.500022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e1f4c-c01a-49fd-b6f4-7b148986b87c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.501995 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e1f4c-c01a-49fd-b6f4-7b148986b87c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.508220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e5775-ffe2-40f6-ad0c-1613fd70eff4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.510047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-260e5775-ffe2-40f6-ad0c-1613fd70eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.541656 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e5775-ffe2-40f6-ad0c-1613fd70eff4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.557381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1006/1994] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/projects => generated 371 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:11.561181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1f4c-c01a-49fd-b6f4-7b148986b87c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.561668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.563836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.563836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.564115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] PATH_INFO: `/v3/projects/2cc0ee76b0844b2784135d16c27dc2f5` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.565934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc0ee76b0844b2784135d16c27dc2f5)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.574922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.631117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:11.686211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1f4c-c01a-49fd-b6f4-7b148986b87c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.716463 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc0ee76b0844b2784135d16c27dc2f5', 'request_id': 'req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.725287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc0ee76b0844b2784135d16c27dc2f5', 'request_id': 'req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.731975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc0ee76b0844b2784135d16c27dc2f5', 'request_id': 'req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.748706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] The token cache is being invalidate because project 2cc0ee76b0844b2784135d16c27dc2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:11.749006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.749691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.757011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 989/1995] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:11 2022] DELETE /identity/v3/projects/2cc0ee76b0844b2784135d16c27dc2f5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:11.757694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988c431-21e3-484d-b772-24aae459d817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.758000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.758389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988c431-21e3-484d-b772-24aae459d817 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.758753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988c431-21e3-484d-b772-24aae459d817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.759060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988c431-21e3-484d-b772-24aae459d817 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.759921 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988c431-21e3-484d-b772-24aae459d817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.760137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.761874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988c431-21e3-484d-b772-24aae459d817 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.775787 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fdf66-46ae-44b1-9ebe-af7c8369072b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.783162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.784210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.784422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.784733 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] PATH_INFO: `/v3/users/e960c833b6814f9f9622963325cb6a24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.785887 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1007/1996] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:11.788078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda138-96d1-4eb4-9242-4d010470f901 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.788433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda138-96d1-4eb4-9242-4d010470f901 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.789019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda138-96d1-4eb4-9242-4d010470f901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.789621 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e960c833b6814f9f9622963325cb6a24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.792314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.810198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ffcda138-96d1-4eb4-9242-4d010470f901 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:11.811256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ffcda138-96d1-4eb4-9242-4d010470f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.827007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1008/1997] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:11.827007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcda138-96d1-4eb4-9242-4d010470f901 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.827007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ffcda138-96d1-4eb4-9242-4d010470f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.839819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcda138-96d1-4eb4-9242-4d010470f901 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.851757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f9f0b-dfe5-43e4-ab40-7d3ba610cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.852438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9f0b-dfe5-43e4-ab40-7d3ba610cbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.852752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9f0b-dfe5-43e4-ab40-7d3ba610cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.853027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9f0b-dfe5-43e4-ab40-7d3ba610cbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.853757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f9f0b-dfe5-43e4-ab40-7d3ba610cbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.855385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f9f0b-dfe5-43e4-ab40-7d3ba610cbb6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.868094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e960c833b6814f9f9622963325cb6a24'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.868582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1009/1998] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:11.869748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbb8b4-36ef-4b6d-b8e6-976730b79dad None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.870016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbb8b4-36ef-4b6d-b8e6-976730b79dad None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.870296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbb8b4-36ef-4b6d-b8e6-976730b79dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.881502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e960c833b6814f9f9622963325cb6a24'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.884648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e960c833b6814f9f9622963325cb6a24'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.885386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e960c833b6814f9f9622963325cb6a24'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.891527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-adcbb8b4-36ef-4b6d-b8e6-976730b79dad None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:11.892721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-adcbb8b4-36ef-4b6d-b8e6-976730b79dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.904661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1010/1999] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:11.904661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbb8b4-36ef-4b6d-b8e6-976730b79dad None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.908036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-adcbb8b4-36ef-4b6d-b8e6-976730b79dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.913868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e960c833b6814f9f9622963325cb6a24'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:11.921901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbb8b4-36ef-4b6d-b8e6-976730b79dad None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.927740 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c90b6-011a-47e2-b557-02c53ae4ab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.929548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c90b6-011a-47e2-b557-02c53ae4ab6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.929667 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c90b6-011a-47e2-b557-02c53ae4ab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.929943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c90b6-011a-47e2-b557-02c53ae4ab6b admin admin] PATH_INFO: `/v3/projects/d1ed8b442d3e485ca4c5bea096df065e/users/9c1d3d9a6e3b48a7b941491d0cb5717a/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.935425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 990/2000] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:11 2022] DELETE /identity/v3/users/e960c833b6814f9f9622963325cb6a24 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:11.936768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.948834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c90b6-011a-47e2-b557-02c53ae4ab6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ed8b442d3e485ca4c5bea096df065e, user_id=9c1d3d9a6e3b48a7b941491d0cb5717a, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.952396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c90b6-011a-47e2-b557-02c53ae4ab6b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.969782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:11.975285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1011/2001] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:11 2022] PUT /identity/v3/projects/d1ed8b442d3e485ca4c5bea096df065e/users/9c1d3d9a6e3b48a7b941491d0cb5717a/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:11.975285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019a45b-c348-4e2b-8b05-5bcab9e1bf65 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.975285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019a45b-c348-4e2b-8b05-5bcab9e1bf65 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.975285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019a45b-c348-4e2b-8b05-5bcab9e1bf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.993107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2019a45b-c348-4e2b-8b05-5bcab9e1bf65 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:11.994532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2019a45b-c348-4e2b-8b05-5bcab9e1bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:12.023685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a63d07-7a1b-4224-9d58-1cbab712402d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.080432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1012/2002] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:12.082335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019a45b-c348-4e2b-8b05-5bcab9e1bf65 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.090457 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36579af-ab7d-4d0a-b675-79c609798a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.091219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36579af-ab7d-4d0a-b675-79c609798a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.092228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36579af-ab7d-4d0a-b675-79c609798a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.092576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36579af-ab7d-4d0a-b675-79c609798a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.093411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36579af-ab7d-4d0a-b675-79c609798a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:12.093793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36579af-ab7d-4d0a-b675-79c609798a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.095490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36579af-ab7d-4d0a-b675-79c609798a32 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:12.108983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 991/2003] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:12.113367 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36579af-ab7d-4d0a-b675-79c609798a32 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.114186 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019a45b-c348-4e2b-8b05-5bcab9e1bf65 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.115609 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a36579af-ab7d-4d0a-b675-79c609798a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:12.120577 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0004f0-93c4-4061-975a-8f1cef357383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.122798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0004f0-93c4-4061-975a-8f1cef357383 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.123092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0004f0-93c4-4061-975a-8f1cef357383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.123447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0004f0-93c4-4061-975a-8f1cef357383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.125419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0004f0-93c4-4061-975a-8f1cef357383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.127383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0004f0-93c4-4061-975a-8f1cef357383 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:12.135224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:12.152172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1013/2004] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:12.153122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0004f0-93c4-4061-975a-8f1cef357383 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.169440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0004f0-93c4-4061-975a-8f1cef357383 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.175408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48611f01-3659-492a-9a42-4d63b90edbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.176309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611f01-3659-492a-9a42-4d63b90edbff admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.176600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611f01-3659-492a-9a42-4d63b90edbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.176935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611f01-3659-492a-9a42-4d63b90edbff admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.178621 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48611f01-3659-492a-9a42-4d63b90edbff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.180713 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48611f01-3659-492a-9a42-4d63b90edbff admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:12.194799 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36579af-ab7d-4d0a-b675-79c609798a32 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.199172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06153e06-624e-4ea2-a04d-04119fdb8d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.200039 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06153e06-624e-4ea2-a04d-04119fdb8d57 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.200500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06153e06-624e-4ea2-a04d-04119fdb8d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.200987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06153e06-624e-4ea2-a04d-04119fdb8d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.212142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06153e06-624e-4ea2-a04d-04119fdb8d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.212456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1014/2005] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:12 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:12.213383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48611f01-3659-492a-9a42-4d63b90edbff admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.219300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06153e06-624e-4ea2-a04d-04119fdb8d57 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:12.234208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 992/2006] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:12.234866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06153e06-624e-4ea2-a04d-04119fdb8d57 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.246513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06153e06-624e-4ea2-a04d-04119fdb8d57 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.339458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604b29d-f8ef-414f-b8b1-4dccee275a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.340140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604b29d-f8ef-414f-b8b1-4dccee275a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.340774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604b29d-f8ef-414f-b8b1-4dccee275a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.340774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604b29d-f8ef-414f-b8b1-4dccee275a6a admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.341472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604b29d-f8ef-414f-b8b1-4dccee275a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.343430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48611f01-3659-492a-9a42-4d63b90edbff admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.343879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604b29d-f8ef-414f-b8b1-4dccee275a6a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:12.348671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be65b8-81a4-4040-99fa-9b153df3d6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.349981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be65b8-81a4-4040-99fa-9b153df3d6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.350339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be65b8-81a4-4040-99fa-9b153df3d6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.350681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be65b8-81a4-4040-99fa-9b153df3d6bb admin admin] PATH_INFO: `/v3/projects/d1ed8b442d3e485ca4c5bea096df065e/users/9c1d3d9a6e3b48a7b941491d0cb5717a/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.352862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be65b8-81a4-4040-99fa-9b153df3d6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ed8b442d3e485ca4c5bea096df065e, user_id=9c1d3d9a6e3b48a7b941491d0cb5717a, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.355547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be65b8-81a4-4040-99fa-9b153df3d6bb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:12.359770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:12.367754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1015/2007] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:12 2022] PUT /identity/v3/projects/d1ed8b442d3e485ca4c5bea096df065e/users/9c1d3d9a6e3b48a7b941491d0cb5717a/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:12.368772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 993/2008] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:12 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:12.373773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be65b8-81a4-4040-99fa-9b153df3d6bb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.487082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be65b8-81a4-4040-99fa-9b153df3d6bb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.499938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccdb3d-0ea6-491d-bbee-1ea9c3e68eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.500841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccdb3d-0ea6-491d-bbee-1ea9c3e68eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.501929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccdb3d-0ea6-491d-bbee-1ea9c3e68eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.502464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccdb3d-0ea6-491d-bbee-1ea9c3e68eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.503598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccdb3d-0ea6-491d-bbee-1ea9c3e68eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.506243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccdb3d-0ea6-491d-bbee-1ea9c3e68eb8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:12.519796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1016/2009] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:12.524823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604b29d-f8ef-414f-b8b1-4dccee275a6a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.538575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604b29d-f8ef-414f-b8b1-4dccee275a6a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.544874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807db2a-66ce-49b8-b524-7772f1c9c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.545775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807db2a-66ce-49b8-b524-7772f1c9c1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.546133 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807db2a-66ce-49b8-b524-7772f1c9c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.546481 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807db2a-66ce-49b8-b524-7772f1c9c1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.547497 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807db2a-66ce-49b8-b524-7772f1c9c1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.549229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807db2a-66ce-49b8-b524-7772f1c9c1bd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:12.562471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 994/2010] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:12.566547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccdb3d-0ea6-491d-bbee-1ea9c3e68eb8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.578022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccdb3d-0ea6-491d-bbee-1ea9c3e68eb8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.585234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f767b5-5aee-413d-a38e-498f0381ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:12.585876 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f767b5-5aee-413d-a38e-498f0381ce15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.586237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f767b5-5aee-413d-a38e-498f0381ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.586527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f767b5-5aee-413d-a38e-498f0381ce15 admin admin] PATH_INFO: `/v3/projects/016fd08eb200468f9f473258047f3102/users/52da091338b64c148064489ac4812ea3/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.615433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f767b5-5aee-413d-a38e-498f0381ce15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=016fd08eb200468f9f473258047f3102, user_id=52da091338b64c148064489ac4812ea3, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:12.620301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f767b5-5aee-413d-a38e-498f0381ce15 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:12.644358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1017/2011] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:12 2022] PUT /identity/v3/projects/016fd08eb200468f9f473258047f3102/users/52da091338b64c148064489ac4812ea3/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:12.656144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f092c9-2c77-4565-b469-2547cea21f22 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:12.656442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f092c9-2c77-4565-b469-2547cea21f22 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:12.657037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f092c9-2c77-4565-b469-2547cea21f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:12.722839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-47f092c9-2c77-4565-b469-2547cea21f22 None None] MFA Rules not processed for user `52da091338b64c148064489ac4812ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:12.724926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-47f092c9-2c77-4565-b469-2547cea21f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:12.813012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f767b5-5aee-413d-a38e-498f0381ce15 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.814999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-18f767b5-5aee-413d-a38e-498f0381ce15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:12.854849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 995/2012] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:12.867044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f092c9-2c77-4565-b469-2547cea21f22 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:12.927585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:12.967548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f767b5-5aee-413d-a38e-498f0381ce15 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:12.999922 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:13.003779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:13.004065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:13.004347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] PATH_INFO: `/v3/projects/2d0c90f713ca45d889407c2ad217fe3b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:13.004896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f092c9-2c77-4565-b469-2547cea21f22 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:13.009089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0c90f713ca45d889407c2ad217fe3b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:13.012793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:13.017592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4869220-774b-4ef5-866f-6038ef49bb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:13.018273 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4869220-774b-4ef5-866f-6038ef49bb27 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:13.019399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4869220-774b-4ef5-866f-6038ef49bb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:13.019701 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4869220-774b-4ef5-866f-6038ef49bb27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:13.020429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4869220-774b-4ef5-866f-6038ef49bb27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:13.027317 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4869220-774b-4ef5-866f-6038ef49bb27 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:13.099585 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 996/2013] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:12 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:13.104818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4869220-774b-4ef5-866f-6038ef49bb27 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:13.138671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0c90f713ca45d889407c2ad217fe3b', 'request_id': 'req-95cf4947-7bd2-431f-abb4-2a20ab26b194'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.151569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0c90f713ca45d889407c2ad217fe3b', 'request_id': 'req-95cf4947-7bd2-431f-abb4-2a20ab26b194'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.166098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0c90f713ca45d889407c2ad217fe3b', 'request_id': 'req-95cf4947-7bd2-431f-abb4-2a20ab26b194'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.200027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] The token cache is being invalidate because project 2d0c90f713ca45d889407c2ad217fe3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:13.200027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.200027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.206384 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1018/2014] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:12 2022] DELETE /identity/v3/projects/2d0c90f713ca45d889407c2ad217fe3b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:13.208255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:13.212349 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:13.309982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4869220-774b-4ef5-866f-6038ef49bb27 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:13.327926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:13.496628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf4947-7bd2-431f-abb4-2a20ab26b194 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:13.508118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:13.509438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:13.509438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:13.509711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] PATH_INFO: `/v3/users/9dc44341a89944cf8f466c783ec233f7` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:13.511051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc44341a89944cf8f466c783ec233f7)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:13.515603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:13.529341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd9ce9-813f-4d00-8185-7c828ded5b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:13.530037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd9ce9-813f-4d00-8185-7c828ded5b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:13.530316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd9ce9-813f-4d00-8185-7c828ded5b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:13.530592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd9ce9-813f-4d00-8185-7c828ded5b0c admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:13.531281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd9ce9-813f-4d00-8185-7c828ded5b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:13.533241 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd9ce9-813f-4d00-8185-7c828ded5b0c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:13.582775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 997/2015] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:13 2022] POST /identity/v3/users => generated 294 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:13.586369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd9ce9-813f-4d00-8185-7c828ded5b0c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:13.591451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-04cd9ce9-813f-4d00-8185-7c828ded5b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:13.635064 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd9ce9-813f-4d00-8185-7c828ded5b0c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:13.638652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc44341a89944cf8f466c783ec233f7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.648025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210b24e-babd-4b17-bf98-ad97d686b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:13.649086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b24e-babd-4b17-bf98-ad97d686b5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:13.649372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b24e-babd-4b17-bf98-ad97d686b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:13.649651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b24e-babd-4b17-bf98-ad97d686b5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:13.650530 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210b24e-babd-4b17-bf98-ad97d686b5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:13.653292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210b24e-babd-4b17-bf98-ad97d686b5a5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:13.657352 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc44341a89944cf8f466c783ec233f7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.662157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc44341a89944cf8f466c783ec233f7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.663238 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc44341a89944cf8f466c783ec233f7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.687435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 998/2016] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:13.689891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc44341a89944cf8f466c783ec233f7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:13.697097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:13.701071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210b24e-babd-4b17-bf98-ad97d686b5a5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:13.703470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a210b24e-babd-4b17-bf98-ad97d686b5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:13.723087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210b24e-babd-4b17-bf98-ad97d686b5a5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:13.733300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e39ff9-f572-49c2-bdbd-f50df6305842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:13.735260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e39ff9-f572-49c2-bdbd-f50df6305842 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:13.736153 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e39ff9-f572-49c2-bdbd-f50df6305842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:13.736872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e39ff9-f572-49c2-bdbd-f50df6305842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:13.741383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1019/2017] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:13 2022] DELETE /identity/v3/users/9dc44341a89944cf8f466c783ec233f7 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:13.744045 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e39ff9-f572-49c2-bdbd-f50df6305842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:13.746519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e39ff9-f572-49c2-bdbd-f50df6305842 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:13.767252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 999/2018] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:13.770453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:13.927493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4dca-4590-4de6-a95b-d6fef3c6580f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:13.933976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4f882-57ee-47f6-9314-141b7d376daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:13.935375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4f882-57ee-47f6-9314-141b7d376daa admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:13.935660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4f882-57ee-47f6-9314-141b7d376daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:13.935933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4f882-57ee-47f6-9314-141b7d376daa admin admin] PATH_INFO: `/v3/projects/b60c3a0706a84060b356c6eb00d69646/users/fdaee8ad84674549adaa14f6eb9b70ab/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:13.967156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4f882-57ee-47f6-9314-141b7d376daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60c3a0706a84060b356c6eb00d69646, user_id=fdaee8ad84674549adaa14f6eb9b70ab, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:13.971670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4f882-57ee-47f6-9314-141b7d376daa admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:13.991916 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1020/2019] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:13 2022] PUT /identity/v3/projects/b60c3a0706a84060b356c6eb00d69646/users/fdaee8ad84674549adaa14f6eb9b70ab/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:14.003677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c512-9e40-4f20-9042-8ee8c86acb5a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.003979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c512-9e40-4f20-9042-8ee8c86acb5a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.004266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c512-9e40-4f20-9042-8ee8c86acb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.044459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3303c512-9e40-4f20-9042-8ee8c86acb5a None None] MFA Rules not processed for user `fdaee8ad84674549adaa14f6eb9b70ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:14.045793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3303c512-9e40-4f20-9042-8ee8c86acb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.059836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebd35-aa39-4e43-b1e4-28708a6bccd5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.060157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebd35-aa39-4e43-b1e4-28708a6bccd5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.060404 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebd35-aa39-4e43-b1e4-28708a6bccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.122075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8b4ebd35-aa39-4e43-b1e4-28708a6bccd5 None None] MFA Rules not processed for user `9c1d3d9a6e3b48a7b941491d0cb5717a`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:14.126310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8b4ebd35-aa39-4e43-b1e4-28708a6bccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.167277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1000/2020] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:14.169034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303c512-9e40-4f20-9042-8ee8c86acb5a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:14.268162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1021/2021] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:14.292542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb924f-4447-4a9b-a7e6-03c62e2d79c6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.292889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb924f-4447-4a9b-a7e6-03c62e2d79c6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.293269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb924f-4447-4a9b-a7e6-03c62e2d79c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.322285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5bbb924f-4447-4a9b-a7e6-03c62e2d79c6 None None] MFA Rules not processed for user `8f625c0a37324e2d996676563cb128b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:14.323534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5bbb924f-4447-4a9b-a7e6-03c62e2d79c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.334663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303c512-9e40-4f20-9042-8ee8c86acb5a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:14.347563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d3b30-9410-41e1-adf8-08ff5edfad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:14.349262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3b30-9410-41e1-adf8-08ff5edfad66 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.349782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3b30-9410-41e1-adf8-08ff5edfad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.350305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3b30-9410-41e1-adf8-08ff5edfad66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.352796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d3b30-9410-41e1-adf8-08ff5edfad66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:14.356674 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d3b30-9410-41e1-adf8-08ff5edfad66 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:14.381634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:14.411975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1001/2022] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:14 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:14.413005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d3b30-9410-41e1-adf8-08ff5edfad66 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:14.416559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0e0d3b30-9410-41e1-adf8-08ff5edfad66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.448412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1022/2023] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:14.462169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb924f-4447-4a9b-a7e6-03c62e2d79c6 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:14.488812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb924f-4447-4a9b-a7e6-03c62e2d79c6 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:14.497675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:14.530090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d3b30-9410-41e1-adf8-08ff5edfad66 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:14.545228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:14.546405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.546699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.547736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] PATH_INFO: `/v3/projects/fa0e0614bbc944299e2eea180640db06` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.552233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0e0614bbc944299e2eea180640db06)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:14.555644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:14.575364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381f201-7d12-4b47-8ea6-5f26f5a48ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:14.576158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f201-7d12-4b47-8ea6-5f26f5a48ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.576493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f201-7d12-4b47-8ea6-5f26f5a48ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.576821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f201-7d12-4b47-8ea6-5f26f5a48ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.577616 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381f201-7d12-4b47-8ea6-5f26f5a48ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:14.579719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381f201-7d12-4b47-8ea6-5f26f5a48ac8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:14.605589 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1023/2024] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:14 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:14.606471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381f201-7d12-4b47-8ea6-5f26f5a48ac8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:14.608075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8381f201-7d12-4b47-8ea6-5f26f5a48ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.646506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0e0614bbc944299e2eea180640db06', 'request_id': 'req-e6eea4e9-c37d-46db-9dce-42828c895f43'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:14.657558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0e0614bbc944299e2eea180640db06', 'request_id': 'req-e6eea4e9-c37d-46db-9dce-42828c895f43'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:14.665588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0e0614bbc944299e2eea180640db06', 'request_id': 'req-e6eea4e9-c37d-46db-9dce-42828c895f43'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:14.683506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] The token cache is being invalidate because project fa0e0614bbc944299e2eea180640db06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:14.683853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:14.684535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:14.688701 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1002/2025] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:14 2022] DELETE /identity/v3/projects/fa0e0614bbc944299e2eea180640db06 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:14.689692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:14.693824 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.736924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381f201-7d12-4b47-8ea6-5f26f5a48ac8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:14.787702 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eea4e9-c37d-46db-9dce-42828c895f43 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:14.794194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8a2a5-f877-464a-8d7a-2a849e8165c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:14.795072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8a2a5-f877-464a-8d7a-2a849e8165c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.795497 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8a2a5-f877-464a-8d7a-2a849e8165c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.795952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8a2a5-f877-464a-8d7a-2a849e8165c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.796756 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8a2a5-f877-464a-8d7a-2a849e8165c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:14.799223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8a2a5-f877-464a-8d7a-2a849e8165c6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:14.812394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1003/2026] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:14.813999 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56011c-3844-4276-852c-8bea5cdea059 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.814353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56011c-3844-4276-852c-8bea5cdea059 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.814703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56011c-3844-4276-852c-8bea5cdea059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.834630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-de56011c-3844-4276-852c-8bea5cdea059 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:14.835937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-de56011c-3844-4276-852c-8bea5cdea059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.845910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1004/2027] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:14.846721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56011c-3844-4276-852c-8bea5cdea059 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:14.863925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56011c-3844-4276-852c-8bea5cdea059 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:14.870857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd50799-cc6e-48bf-9d82-513cbdd65238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:14.871882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd50799-cc6e-48bf-9d82-513cbdd65238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.872371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd50799-cc6e-48bf-9d82-513cbdd65238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.872748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd50799-cc6e-48bf-9d82-513cbdd65238 admin admin] PATH_INFO: `/v3/projects/a81e7e62f8d740898294a4ea80ed243e/users/d1c367cadf7141a99de92d583518c1d5/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.882980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:14.885415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d9f5c-3b70-4669-89e9-8a6d3618a1b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:14.887271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9f5c-3b70-4669-89e9-8a6d3618a1b6 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.887563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9f5c-3b70-4669-89e9-8a6d3618a1b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.887844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9f5c-3b70-4669-89e9-8a6d3618a1b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.892848 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5f9d9f5c-3b70-4669-89e9-8a6d3618a1b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.901209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd50799-cc6e-48bf-9d82-513cbdd65238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81e7e62f8d740898294a4ea80ed243e, user_id=d1c367cadf7141a99de92d583518c1d5, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:14.906551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd50799-cc6e-48bf-9d82-513cbdd65238 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:14.926613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1005/2028] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:14 2022] PUT /identity/v3/projects/a81e7e62f8d740898294a4ea80ed243e/users/d1c367cadf7141a99de92d583518c1d5/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:14.930657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9933aa1-d298-4ce6-b458-e67b1afeaccd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:14.931190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9933aa1-d298-4ce6-b458-e67b1afeaccd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:14.931486 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9933aa1-d298-4ce6-b458-e67b1afeaccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:14.947512 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:14.961300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d9933aa1-d298-4ce6-b458-e67b1afeaccd None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:14.962556 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d9933aa1-d298-4ce6-b458-e67b1afeaccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:14.994362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d9f5c-3b70-4669-89e9-8a6d3618a1b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:14.996145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d9f5c-3b70-4669-89e9-8a6d3618a1b6 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.007027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1024/2029] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:15.011636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d9f5c-3b70-4669-89e9-8a6d3618a1b6 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.013463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5f9d9f5c-3b70-4669-89e9-8a6d3618a1b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.038811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d9f5c-3b70-4669-89e9-8a6d3618a1b6 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.056388 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1006/2030] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:15.057641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9933aa1-d298-4ce6-b458-e67b1afeaccd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.069169 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9933aa1-d298-4ce6-b458-e67b1afeaccd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.075032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023983e-0627-4a62-8686-cdf94092b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.075902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023983e-0627-4a62-8686-cdf94092b414 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.076191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023983e-0627-4a62-8686-cdf94092b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.076468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023983e-0627-4a62-8686-cdf94092b414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.077233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023983e-0627-4a62-8686-cdf94092b414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.086828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023983e-0627-4a62-8686-cdf94092b414 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.110830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1007/2031] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:15.110830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023983e-0627-4a62-8686-cdf94092b414 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.118355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff123d-eb54-4294-b6b5-157927f1bc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.119666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff123d-eb54-4294-b6b5-157927f1bc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.120153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff123d-eb54-4294-b6b5-157927f1bc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.120643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff123d-eb54-4294-b6b5-157927f1bc05 admin admin] PATH_INFO: `/v3/users/8cc4cf810b2c44be9674cce10763915e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.122076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff123d-eb54-4294-b6b5-157927f1bc05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc4cf810b2c44be9674cce10763915e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.122205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023983e-0627-4a62-8686-cdf94092b414 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.124702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff123d-eb54-4294-b6b5-157927f1bc05 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.127376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdac44-d19d-459b-8067-1fe7eecaf6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.128042 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdac44-d19d-459b-8067-1fe7eecaf6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.128330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdac44-d19d-459b-8067-1fe7eecaf6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.128631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdac44-d19d-459b-8067-1fe7eecaf6c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.129375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdac44-d19d-459b-8067-1fe7eecaf6c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:15.129693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdac44-d19d-459b-8067-1fe7eecaf6c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.131344 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdac44-d19d-459b-8067-1fe7eecaf6c8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.148030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1008/2032] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:15.148030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdac44-d19d-459b-8067-1fe7eecaf6c8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.167297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdac44-d19d-459b-8067-1fe7eecaf6c8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.175938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19ef47-4757-4029-bc8d-0394b924b42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.177503 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ef47-4757-4029-bc8d-0394b924b42d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.177947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ef47-4757-4029-bc8d-0394b924b42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.178236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ef47-4757-4029-bc8d-0394b924b42d admin admin] PATH_INFO: `/v3/projects/a81e7e62f8d740898294a4ea80ed243e/users/d1c367cadf7141a99de92d583518c1d5/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.181141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19ef47-4757-4029-bc8d-0394b924b42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81e7e62f8d740898294a4ea80ed243e, user_id=d1c367cadf7141a99de92d583518c1d5, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.186108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19ef47-4757-4029-bc8d-0394b924b42d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.203296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1009/2033] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:15 2022] PUT /identity/v3/projects/a81e7e62f8d740898294a4ea80ed243e/users/d1c367cadf7141a99de92d583518c1d5/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:15.205473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c5ff123d-eb54-4294-b6b5-157927f1bc05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc4cf810b2c44be9674cce10763915e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.206775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19ef47-4757-4029-bc8d-0394b924b42d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.217045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c5ff123d-eb54-4294-b6b5-157927f1bc05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc4cf810b2c44be9674cce10763915e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.219781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c5ff123d-eb54-4294-b6b5-157927f1bc05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc4cf810b2c44be9674cce10763915e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.221248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c5ff123d-eb54-4294-b6b5-157927f1bc05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc4cf810b2c44be9674cce10763915e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.249844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c5ff123d-eb54-4294-b6b5-157927f1bc05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc4cf810b2c44be9674cce10763915e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:15.276683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1025/2034] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:15 2022] DELETE /identity/v3/users/8cc4cf810b2c44be9674cce10763915e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:15.278204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a18a3-8532-4a63-927e-b00bc2b2880d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.278571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a18a3-8532-4a63-927e-b00bc2b2880d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.279127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a18a3-8532-4a63-927e-b00bc2b2880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.310758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c60a18a3-8532-4a63-927e-b00bc2b2880d None None] MFA Rules not processed for user `d1c367cadf7141a99de92d583518c1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:15.311989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c60a18a3-8532-4a63-927e-b00bc2b2880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.337676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19ef47-4757-4029-bc8d-0394b924b42d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.358496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:15.417257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1026/2035] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:15.419029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f062fc-d5d1-47f4-aeed-69d9b83253de None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.419615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f062fc-d5d1-47f4-aeed-69d9b83253de None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.419905 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f062fc-d5d1-47f4-aeed-69d9b83253de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.426286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:15.437423 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c227-eb4f-4950-8928-9e0eea936522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.438387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c227-eb4f-4950-8928-9e0eea936522 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.438750 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c227-eb4f-4950-8928-9e0eea936522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.439573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c227-eb4f-4950-8928-9e0eea936522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.440039 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5c227-eb4f-4950-8928-9e0eea936522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.443175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5c227-eb4f-4950-8928-9e0eea936522 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.464721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-62f062fc-d5d1-47f4-aeed-69d9b83253de None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:15.466683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-62f062fc-d5d1-47f4-aeed-69d9b83253de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.494040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1027/2036] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:15.494951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f062fc-d5d1-47f4-aeed-69d9b83253de None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.497219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-62f062fc-d5d1-47f4-aeed-69d9b83253de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.512663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1010/2037] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:15 2022] POST /identity/v3/projects => generated 367 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:15.514196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c227-eb4f-4950-8928-9e0eea936522 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.515941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e0e5c227-eb4f-4950-8928-9e0eea936522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.607385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f062fc-d5d1-47f4-aeed-69d9b83253de None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.634506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c227-eb4f-4950-8928-9e0eea936522 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.643243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac13ec-efd1-4e2c-9f12-c3fa3b58ac51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.643922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac13ec-efd1-4e2c-9f12-c3fa3b58ac51 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.644209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac13ec-efd1-4e2c-9f12-c3fa3b58ac51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.644489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac13ec-efd1-4e2c-9f12-c3fa3b58ac51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.740920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac13ec-efd1-4e2c-9f12-c3fa3b58ac51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.742378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac13ec-efd1-4e2c-9f12-c3fa3b58ac51 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.759405 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b4d05-1f85-4e51-a5c4-ef6059511430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.759606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b4d05-1f85-4e51-a5c4-ef6059511430 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.759867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b4d05-1f85-4e51-a5c4-ef6059511430 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.760147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b4d05-1f85-4e51-a5c4-ef6059511430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.763850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1011/2038] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:15.764898 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac13ec-efd1-4e2c-9f12-c3fa3b58ac51 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.766516 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-86ac13ec-efd1-4e2c-9f12-c3fa3b58ac51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:15.792478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac13ec-efd1-4e2c-9f12-c3fa3b58ac51 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.800600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fa2ac-f814-4b3b-a004-6727bf8727c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.802252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fa2ac-f814-4b3b-a004-6727bf8727c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.802906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fa2ac-f814-4b3b-a004-6727bf8727c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.803422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fa2ac-f814-4b3b-a004-6727bf8727c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.804685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fa2ac-f814-4b3b-a004-6727bf8727c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.807675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fa2ac-f814-4b3b-a004-6727bf8727c1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.850156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1012/2039] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:15 2022] POST /identity/v3/users => generated 284 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:15.851639 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fa2ac-f814-4b3b-a004-6727bf8727c1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.864536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fa2ac-f814-4b3b-a004-6727bf8727c1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.872036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9135ed-08be-42df-9c52-be7a752a30c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.872775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9135ed-08be-42df-9c52-be7a752a30c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.873066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9135ed-08be-42df-9c52-be7a752a30c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.873348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9135ed-08be-42df-9c52-be7a752a30c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.874088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9135ed-08be-42df-9c52-be7a752a30c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.890227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9135ed-08be-42df-9c52-be7a752a30c7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.929144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1013/2040] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:15.930056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9135ed-08be-42df-9c52-be7a752a30c7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:15.948542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b4d05-1f85-4e51-a5c4-ef6059511430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:15.950049 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b4d05-1f85-4e51-a5c4-ef6059511430 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:15.961842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9135ed-08be-42df-9c52-be7a752a30c7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:15.963689 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1028/2041] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:15.997749 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51f62d-b09a-46a9-b45a-3a1f2283017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:15.998075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51f62d-b09a-46a9-b45a-3a1f2283017c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:15.998309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51f62d-b09a-46a9-b45a-3a1f2283017c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:15.998593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51f62d-b09a-46a9-b45a-3a1f2283017c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:15.999328 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51f62d-b09a-46a9-b45a-3a1f2283017c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.001412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51f62d-b09a-46a9-b45a-3a1f2283017c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.027304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1014/2042] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:16.028387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b4d05-1f85-4e51-a5c4-ef6059511430 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.057199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b4d05-1f85-4e51-a5c4-ef6059511430 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.060964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e87a7a-3327-45a8-ad37-54d0b11c9400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.062513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e87a7a-3327-45a8-ad37-54d0b11c9400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.062794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e87a7a-3327-45a8-ad37-54d0b11c9400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.063072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e87a7a-3327-45a8-ad37-54d0b11c9400 admin admin] PATH_INFO: `/v3/projects/06ad7855d20c4ad7a2b15ea70e6ec9ab/users/ab1fbc1057de4d879f3a30902577adf1/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.091627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e87a7a-3327-45a8-ad37-54d0b11c9400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ad7855d20c4ad7a2b15ea70e6ec9ab, user_id=ab1fbc1057de4d879f3a30902577adf1, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.094525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e87a7a-3327-45a8-ad37-54d0b11c9400 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.120681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1029/2043] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:16 2022] PUT /identity/v3/projects/06ad7855d20c4ad7a2b15ea70e6ec9ab/users/ab1fbc1057de4d879f3a30902577adf1/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:16.128836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dca8e9-2f6c-488a-bd47-0e45e8d1c4d5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.129359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dca8e9-2f6c-488a-bd47-0e45e8d1c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.129438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dca8e9-2f6c-488a-bd47-0e45e8d1c4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.163729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-34dca8e9-2f6c-488a-bd47-0e45e8d1c4d5 None None] MFA Rules not processed for user `ab1fbc1057de4d879f3a30902577adf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:16.173637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-34dca8e9-2f6c-488a-bd47-0e45e8d1c4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:16.307321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:16.328669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e87a7a-3327-45a8-ad37-54d0b11c9400 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.329679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-74e87a7a-3327-45a8-ad37-54d0b11c9400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:16.373918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1015/2044] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:16.375796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:16.378956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dca8e9-2f6c-488a-bd47-0e45e8d1c4d5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.517058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e87a7a-3327-45a8-ad37-54d0b11c9400 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.540146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.541077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.541250 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.541531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] PATH_INFO: `/v3/projects/9bcf78a29e994c0398db2fd73955da63` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.543206 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bcf78a29e994c0398db2fd73955da63)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.544734 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.545145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dca8e9-2f6c-488a-bd47-0e45e8d1c4d5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.551608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29cf69-c2ed-425a-b5c7-a76f5bb3d87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.552671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29cf69-c2ed-425a-b5c7-a76f5bb3d87a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.553901 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29cf69-c2ed-425a-b5c7-a76f5bb3d87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.554507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29cf69-c2ed-425a-b5c7-a76f5bb3d87a admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.555358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29cf69-c2ed-425a-b5c7-a76f5bb3d87a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.572358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29cf69-c2ed-425a-b5c7-a76f5bb3d87a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.639784 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bcf78a29e994c0398db2fd73955da63', 'request_id': 'req-1eb927db-b594-490f-b34f-462ce7185460'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.655456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1016/2045] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:16 2022] POST /identity/v3/projects => generated 367 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:16.659904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29cf69-c2ed-425a-b5c7-a76f5bb3d87a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.663015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bcf78a29e994c0398db2fd73955da63', 'request_id': 'req-1eb927db-b594-490f-b34f-462ce7185460'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.687672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bcf78a29e994c0398db2fd73955da63', 'request_id': 'req-1eb927db-b594-490f-b34f-462ce7185460'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.707313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] The token cache is being invalidate because project 9bcf78a29e994c0398db2fd73955da63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:16.707648 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.709289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.711177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1030/2046] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:16 2022] DELETE /identity/v3/projects/9bcf78a29e994c0398db2fd73955da63 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:16.715173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.728111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:16.781711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29cf69-c2ed-425a-b5c7-a76f5bb3d87a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.788128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5331edc-e08a-4b78-9249-2a6407078d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.789116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5331edc-e08a-4b78-9249-2a6407078d35 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.789525 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5331edc-e08a-4b78-9249-2a6407078d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.789871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5331edc-e08a-4b78-9249-2a6407078d35 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.790770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5331edc-e08a-4b78-9249-2a6407078d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.792834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5331edc-e08a-4b78-9249-2a6407078d35 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.829828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1017/2047] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:16 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:16.835026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5331edc-e08a-4b78-9249-2a6407078d35 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.837149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e5331edc-e08a-4b78-9249-2a6407078d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:16.858618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb927db-b594-490f-b34f-462ce7185460 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.864036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.866253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.866545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.866829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] PATH_INFO: `/v3/users/29f075b1613e4123bb3c15cf801093e9` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.868301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f075b1613e4123bb3c15cf801093e9)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.870364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.873874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5331edc-e08a-4b78-9249-2a6407078d35 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.890544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba5a71-65bc-4b91-9490-74d311c35de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.891662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5a71-65bc-4b91-9490-74d311c35de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.892157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5a71-65bc-4b91-9490-74d311c35de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.892642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba5a71-65bc-4b91-9490-74d311c35de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.894245 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba5a71-65bc-4b91-9490-74d311c35de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.898974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba5a71-65bc-4b91-9490-74d311c35de2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.938961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1018/2048] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:16.943710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba5a71-65bc-4b91-9490-74d311c35de2 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.961506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba5a71-65bc-4b91-9490-74d311c35de2 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.962735 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:16.967661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f075b1613e4123bb3c15cf801093e9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.975030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b3ae8-3666-469b-98e4-bcbe2afdb3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.975937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3ae8-3666-469b-98e4-bcbe2afdb3a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.976224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3ae8-3666-469b-98e4-bcbe2afdb3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.976505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3ae8-3666-469b-98e4-bcbe2afdb3a8 admin admin] PATH_INFO: `/v3/projects/d9e7cabfadb24e9fb71c4e14fa835aec/users/7f66a9b8068c4cec95516f45947a5036/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.984840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f075b1613e4123bb3c15cf801093e9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.985671 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f075b1613e4123bb3c15cf801093e9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.986358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f075b1613e4123bb3c15cf801093e9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.001203 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f075b1613e4123bb3c15cf801093e9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.014903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b3ae8-3666-469b-98e4-bcbe2afdb3a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e7cabfadb24e9fb71c4e14fa835aec, user_id=7f66a9b8068c4cec95516f45947a5036, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.019002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b3ae8-3666-469b-98e4-bcbe2afdb3a8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.032204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1031/2049] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:16 2022] DELETE /identity/v3/users/29f075b1613e4123bb3c15cf801093e9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:17.033044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.038271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.043653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1019/2050] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:16 2022] PUT /identity/v3/projects/d9e7cabfadb24e9fb71c4e14fa835aec/users/7f66a9b8068c4cec95516f45947a5036/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:17.048183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b3ae8-3666-469b-98e4-bcbe2afdb3a8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.057666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0c6b3ae8-3666-469b-98e4-bcbe2afdb3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.157738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:17.179553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de319025-f983-4043-9225-b50d45fc7da6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.247729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b3ae8-3666-469b-98e4-bcbe2afdb3a8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.253182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7f6dc-e0da-43f4-9332-efb056266a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.254066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f6dc-e0da-43f4-9332-efb056266a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.254536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f6dc-e0da-43f4-9332-efb056266a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.255837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f6dc-e0da-43f4-9332-efb056266a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.256796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7f6dc-e0da-43f4-9332-efb056266a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.258607 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7f6dc-e0da-43f4-9332-efb056266a36 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.266635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d53f4-20a4-4d23-9ff3-be297003ba13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.267395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d53f4-20a4-4d23-9ff3-be297003ba13 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.267753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d53f4-20a4-4d23-9ff3-be297003ba13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.268137 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d53f4-20a4-4d23-9ff3-be297003ba13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.269669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1020/2051] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:17.270221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2c1d53f4-20a4-4d23-9ff3-be297003ba13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.274447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7f6dc-e0da-43f4-9332-efb056266a36 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.288842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7f6dc-e0da-43f4-9332-efb056266a36 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.294209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20b725-62c7-4dd6-9c52-bc00bdca931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.295286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b725-62c7-4dd6-9c52-bc00bdca931c admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.295709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b725-62c7-4dd6-9c52-bc00bdca931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.295997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20b725-62c7-4dd6-9c52-bc00bdca931c admin admin] PATH_INFO: `/v3/projects/d9e7cabfadb24e9fb71c4e14fa835aec/users/7f66a9b8068c4cec95516f45947a5036/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.298269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20b725-62c7-4dd6-9c52-bc00bdca931c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e7cabfadb24e9fb71c4e14fa835aec, user_id=7f66a9b8068c4cec95516f45947a5036, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.301015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20b725-62c7-4dd6-9c52-bc00bdca931c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.317382 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1021/2052] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:17 2022] PUT /identity/v3/projects/d9e7cabfadb24e9fb71c4e14fa835aec/users/7f66a9b8068c4cec95516f45947a5036/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:17.335324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4331b-d65b-48f2-a6de-ca8be03b5cb1 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.335619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4331b-d65b-48f2-a6de-ca8be03b5cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.335985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4331b-d65b-48f2-a6de-ca8be03b5cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.357475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d53f4-20a4-4d23-9ff3-be297003ba13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.359804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d53f4-20a4-4d23-9ff3-be297003ba13 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.377172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1032/2053] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:17.384098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-37a4331b-d65b-48f2-a6de-ca8be03b5cb1 None None] MFA Rules not processed for user `7f66a9b8068c4cec95516f45947a5036`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:17.387079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-37a4331b-d65b-48f2-a6de-ca8be03b5cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.553463 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1022/2054] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:17.569544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d53f4-20a4-4d23-9ff3-be297003ba13 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.571029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2c1d53f4-20a4-4d23-9ff3-be297003ba13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.583111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d53f4-20a4-4d23-9ff3-be297003ba13 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.648230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:17.731068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef869f-cd39-473d-bc23-ff2901512932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.731692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef869f-cd39-473d-bc23-ff2901512932 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.732009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef869f-cd39-473d-bc23-ff2901512932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.732235 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef869f-cd39-473d-bc23-ff2901512932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.760529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef869f-cd39-473d-bc23-ff2901512932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.762475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef869f-cd39-473d-bc23-ff2901512932 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.775493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1033/2055] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:17.895767 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4331b-d65b-48f2-a6de-ca8be03b5cb1 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.916380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4331b-d65b-48f2-a6de-ca8be03b5cb1 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.929593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5620b7-47c8-4a31-a9b9-3eb6cdd850b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.930282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5620b7-47c8-4a31-a9b9-3eb6cdd850b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.930576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5620b7-47c8-4a31-a9b9-3eb6cdd850b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.930858 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5620b7-47c8-4a31-a9b9-3eb6cdd850b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.936889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3a5620b7-47c8-4a31-a9b9-3eb6cdd850b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.986986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef869f-cd39-473d-bc23-ff2901512932 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.988506 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-31ef869f-cd39-473d-bc23-ff2901512932 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:18.117690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5620b7-47c8-4a31-a9b9-3eb6cdd850b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.120197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5620b7-47c8-4a31-a9b9-3eb6cdd850b2 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.134677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1023/2056] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:18.181776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef869f-cd39-473d-bc23-ff2901512932 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.196836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.197768 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.198165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.198347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] PATH_INFO: `/v3/projects/29231d0d423d4d9c990d6d58f2afacfe` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.199657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=29231d0d423d4d9c990d6d58f2afacfe)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.201926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.263421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29231d0d423d4d9c990d6d58f2afacfe', 'request_id': 'req-f98cf64f-9288-4d76-98a9-64701b6ba4bb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:18.272032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29231d0d423d4d9c990d6d58f2afacfe', 'request_id': 'req-f98cf64f-9288-4d76-98a9-64701b6ba4bb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:18.284473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29231d0d423d4d9c990d6d58f2afacfe', 'request_id': 'req-f98cf64f-9288-4d76-98a9-64701b6ba4bb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:18.311909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] The token cache is being invalidate because project 29231d0d423d4d9c990d6d58f2afacfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:18.312233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:18.314470 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f98cf64f-9288-4d76-98a9-64701b6ba4bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:18.325462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1034/2057] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:17 2022] DELETE /identity/v3/projects/29231d0d423d4d9c990d6d58f2afacfe => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:18.327533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cfa3e-6c06-47d3-9543-d1d76b1d7337 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.328368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cfa3e-6c06-47d3-9543-d1d76b1d7337 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.328826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cfa3e-6c06-47d3-9543-d1d76b1d7337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.358871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-728cfa3e-6c06-47d3-9543-d1d76b1d7337 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:18.361195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-728cfa3e-6c06-47d3-9543-d1d76b1d7337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:18.407881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:18.474541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1024/2058] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:18.477248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a157f6-833b-4b01-b045-2636d37c2151 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.477546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a157f6-833b-4b01-b045-2636d37c2151 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.477827 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a157f6-833b-4b01-b045-2636d37c2151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.503781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-77a157f6-833b-4b01-b045-2636d37c2151 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:18.505792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-77a157f6-833b-4b01-b045-2636d37c2151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:18.521767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1035/2059] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:18.522974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cfa3e-6c06-47d3-9543-d1d76b1d7337 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.538016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cfa3e-6c06-47d3-9543-d1d76b1d7337 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.557353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8031f-c495-45f5-aed8-a26ef28b0eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.558148 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8031f-c495-45f5-aed8-a26ef28b0eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.558789 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8031f-c495-45f5-aed8-a26ef28b0eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.559178 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8031f-c495-45f5-aed8-a26ef28b0eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.560029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8031f-c495-45f5-aed8-a26ef28b0eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:18.560444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8031f-c495-45f5-aed8-a26ef28b0eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.563186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8031f-c495-45f5-aed8-a26ef28b0eaf admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.585782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1025/2060] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:18.593867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a157f6-833b-4b01-b045-2636d37c2151 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.610673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a157f6-833b-4b01-b045-2636d37c2151 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.629733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3a948-61ae-443a-8118-417e0a9c2565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.631328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a948-61ae-443a-8118-417e0a9c2565 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.631659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a948-61ae-443a-8118-417e0a9c2565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.631944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a948-61ae-443a-8118-417e0a9c2565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.632692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3a948-61ae-443a-8118-417e0a9c2565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.635532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3a948-61ae-443a-8118-417e0a9c2565 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.694680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1036/2061] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:18 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:18.698849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8031f-c495-45f5-aed8-a26ef28b0eaf admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.709481 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8031f-c495-45f5-aed8-a26ef28b0eaf admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.780961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764de9f6-df33-4582-a385-1b8853524194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.781680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764de9f6-df33-4582-a385-1b8853524194 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.782028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764de9f6-df33-4582-a385-1b8853524194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.782390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764de9f6-df33-4582-a385-1b8853524194 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.783085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764de9f6-df33-4582-a385-1b8853524194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.785092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764de9f6-df33-4582-a385-1b8853524194 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.807840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1026/2062] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:18 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:18.811914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3a948-61ae-443a-8118-417e0a9c2565 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.822197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3a948-61ae-443a-8118-417e0a9c2565 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.826856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab40684-b0a3-423a-82bd-b4f4e7d7db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.827503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40684-b0a3-423a-82bd-b4f4e7d7db68 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.827787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40684-b0a3-423a-82bd-b4f4e7d7db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.828063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40684-b0a3-423a-82bd-b4f4e7d7db68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.828826 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab40684-b0a3-423a-82bd-b4f4e7d7db68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.830437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab40684-b0a3-423a-82bd-b4f4e7d7db68 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.840842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1037/2063] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:18.844545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764de9f6-df33-4582-a385-1b8853524194 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.855051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764de9f6-df33-4582-a385-1b8853524194 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.859620 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf30fd-3b10-4a7d-a552-4f345206b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.860270 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf30fd-3b10-4a7d-a552-4f345206b493 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.860561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf30fd-3b10-4a7d-a552-4f345206b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.860869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf30fd-3b10-4a7d-a552-4f345206b493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.861597 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf30fd-3b10-4a7d-a552-4f345206b493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.863207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf30fd-3b10-4a7d-a552-4f345206b493 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.874469 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1027/2064] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:18.878717 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab40684-b0a3-423a-82bd-b4f4e7d7db68 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.889291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab40684-b0a3-423a-82bd-b4f4e7d7db68 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.894515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf673d1-8a91-4d1c-a475-8a3ef293feeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.895408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf673d1-8a91-4d1c-a475-8a3ef293feeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.895737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf673d1-8a91-4d1c-a475-8a3ef293feeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.896160 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf673d1-8a91-4d1c-a475-8a3ef293feeb admin admin] PATH_INFO: `/v3/projects/6b4e13fff7754a4d9c12f197b8703413/users/10e68d5c5b914fe9b46fa3ffff39a77e/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.911843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf673d1-8a91-4d1c-a475-8a3ef293feeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4e13fff7754a4d9c12f197b8703413, user_id=10e68d5c5b914fe9b46fa3ffff39a77e, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.914666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf673d1-8a91-4d1c-a475-8a3ef293feeb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.924044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:18.930383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1038/2065] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:18 2022] PUT /identity/v3/projects/6b4e13fff7754a4d9c12f197b8703413/users/10e68d5c5b914fe9b46fa3ffff39a77e/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:18.940994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570b153-00a4-43df-b268-be10edc205bb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.941290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570b153-00a4-43df-b268-be10edc205bb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.941572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570b153-00a4-43df-b268-be10edc205bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.971727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3570b153-00a4-43df-b268-be10edc205bb None None] MFA Rules not processed for user `10e68d5c5b914fe9b46fa3ffff39a77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:18.973011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3570b153-00a4-43df-b268-be10edc205bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:19.043450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1028/2066] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:19.055013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf673d1-8a91-4d1c-a475-8a3ef293feeb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:19.056766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-daf673d1-8a91-4d1c-a475-8a3ef293feeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:19.126846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf673d1-8a91-4d1c-a475-8a3ef293feeb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:19.131498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055d46a-0828-4a32-bece-15e3cd6f3f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:19.132199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d46a-0828-4a32-bece-15e3cd6f3f71 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:19.132486 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d46a-0828-4a32-bece-15e3cd6f3f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:19.132802 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d46a-0828-4a32-bece-15e3cd6f3f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:19.143824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055d46a-0828-4a32-bece-15e3cd6f3f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:19.145408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055d46a-0828-4a32-bece-15e3cd6f3f71 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:19.157178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1039/2067] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:19.180242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570b153-00a4-43df-b268-be10edc205bb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:19.207009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:19.245076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570b153-00a4-43df-b268-be10edc205bb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:19.249849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:19.250729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:19.251012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:19.251287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] PATH_INFO: `/v3/users/10e68d5c5b914fe9b46fa3ffff39a77e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:19.252490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e68d5c5b914fe9b46fa3ffff39a77e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:19.254445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:19.307089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e68d5c5b914fe9b46fa3ffff39a77e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.314485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e68d5c5b914fe9b46fa3ffff39a77e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.315109 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e68d5c5b914fe9b46fa3ffff39a77e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.315715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e68d5c5b914fe9b46fa3ffff39a77e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.328125 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e68d5c5b914fe9b46fa3ffff39a77e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:19.341728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1029/2068] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:19 2022] DELETE /identity/v3/users/10e68d5c5b914fe9b46fa3ffff39a77e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:19.346163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e619756-a7bf-4ca0-8e60-ef957abbbdee None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:19.346460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e619756-a7bf-4ca0-8e60-ef957abbbdee None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:19.346739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e619756-a7bf-4ca0-8e60-ef957abbbdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:19.365330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6e619756-a7bf-4ca0-8e60-ef957abbbdee None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:19.367026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6e619756-a7bf-4ca0-8e60-ef957abbbdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:19.443709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1040/2069] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:19.453364 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:19.454936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:19.524344 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aa394-e196-4aa0-8463-242967c1ee4f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:19.528696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747e3e5-f2b2-4c50-97e1-9aa6e9718cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:19.529509 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e3e5-f2b2-4c50-97e1-9aa6e9718cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:19.529801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e3e5-f2b2-4c50-97e1-9aa6e9718cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:19.530090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e3e5-f2b2-4c50-97e1-9aa6e9718cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:19.541654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747e3e5-f2b2-4c50-97e1-9aa6e9718cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:19.543135 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747e3e5-f2b2-4c50-97e1-9aa6e9718cf4 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:19.554265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1030/2070] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:20.153672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e619756-a7bf-4ca0-8e60-ef957abbbdee None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.155249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6e619756-a7bf-4ca0-8e60-ef957abbbdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:20.169492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e619756-a7bf-4ca0-8e60-ef957abbbdee None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.174600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.175475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.175904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.176175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] PATH_INFO: `/v3/projects/6b4e13fff7754a4d9c12f197b8703413` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.177463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4e13fff7754a4d9c12f197b8703413)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.179549 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.229009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4e13fff7754a4d9c12f197b8703413', 'request_id': 'req-35663566-39cf-432a-8d57-394badf4fdac'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.235107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4e13fff7754a4d9c12f197b8703413', 'request_id': 'req-35663566-39cf-432a-8d57-394badf4fdac'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.243696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4e13fff7754a4d9c12f197b8703413', 'request_id': 'req-35663566-39cf-432a-8d57-394badf4fdac'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.254800 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] The token cache is being invalidate because project 6b4e13fff7754a4d9c12f197b8703413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:20.255666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.256385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-35663566-39cf-432a-8d57-394badf4fdac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:20.257962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1041/2071] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:20 2022] DELETE /identity/v3/projects/6b4e13fff7754a4d9c12f197b8703413 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:20.262885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d1fe0-a75a-43b3-b3c1-6e393ddf6496 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.263179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d1fe0-a75a-43b3-b3c1-6e393ddf6496 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.263459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d1fe0-a75a-43b3-b3c1-6e393ddf6496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.282338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-569d1fe0-a75a-43b3-b3c1-6e393ddf6496 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:20.283618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-569d1fe0-a75a-43b3-b3c1-6e393ddf6496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:20.338674 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:20.364173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1031/2072] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:20.373208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e3182-3e28-472c-97d9-96475bcb8750 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.373942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e3182-3e28-472c-97d9-96475bcb8750 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.374462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e3182-3e28-472c-97d9-96475bcb8750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.396503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c09e3182-3e28-472c-97d9-96475bcb8750 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:20.398132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c09e3182-3e28-472c-97d9-96475bcb8750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:20.408221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1042/2073] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:20.412686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d1fe0-a75a-43b3-b3c1-6e393ddf6496 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.423975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d1fe0-a75a-43b3-b3c1-6e393ddf6496 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.430157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44ca8f-48ea-4c56-a7ae-4123f42ae5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.430849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44ca8f-48ea-4c56-a7ae-4123f42ae5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.431142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44ca8f-48ea-4c56-a7ae-4123f42ae5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.431485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44ca8f-48ea-4c56-a7ae-4123f42ae5b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.433170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44ca8f-48ea-4c56-a7ae-4123f42ae5b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:20.433288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44ca8f-48ea-4c56-a7ae-4123f42ae5b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.436195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44ca8f-48ea-4c56-a7ae-4123f42ae5b5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.468058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1032/2074] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:20.469760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e3182-3e28-472c-97d9-96475bcb8750 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.479685 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e3182-3e28-472c-97d9-96475bcb8750 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.488935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c523df1-e321-4747-b634-97e28fcd11c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.490413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523df1-e321-4747-b634-97e28fcd11c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.490929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523df1-e321-4747-b634-97e28fcd11c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.491448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523df1-e321-4747-b634-97e28fcd11c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.492416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c523df1-e321-4747-b634-97e28fcd11c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.494979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c523df1-e321-4747-b634-97e28fcd11c0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.521492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:20.534501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1043/2075] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:20 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:20.535636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44ca8f-48ea-4c56-a7ae-4123f42ae5b5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.547604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44ca8f-48ea-4c56-a7ae-4123f42ae5b5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.633974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babb104-57bf-4b55-b00a-0d23508f9d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.634718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babb104-57bf-4b55-b00a-0d23508f9d55 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.634944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babb104-57bf-4b55-b00a-0d23508f9d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.635233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babb104-57bf-4b55-b00a-0d23508f9d55 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.635959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babb104-57bf-4b55-b00a-0d23508f9d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.637976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babb104-57bf-4b55-b00a-0d23508f9d55 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.667387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1033/2076] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:20 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:20.671566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c523df1-e321-4747-b634-97e28fcd11c0 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.683034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c523df1-e321-4747-b634-97e28fcd11c0 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.688304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538d1a7-65a9-469d-ad9c-1054c80029da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.690143 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538d1a7-65a9-469d-ad9c-1054c80029da admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.690143 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538d1a7-65a9-469d-ad9c-1054c80029da admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.690344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538d1a7-65a9-469d-ad9c-1054c80029da admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.691073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538d1a7-65a9-469d-ad9c-1054c80029da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.694812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538d1a7-65a9-469d-ad9c-1054c80029da admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.714973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babb104-57bf-4b55-b00a-0d23508f9d55 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.722566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1044/2077] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:20.727954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babb104-57bf-4b55-b00a-0d23508f9d55 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.733448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a647cf1-d3d0-435e-a41c-0c613da5bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.734161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a647cf1-d3d0-435e-a41c-0c613da5bf74 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.734449 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a647cf1-d3d0-435e-a41c-0c613da5bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.734776 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a647cf1-d3d0-435e-a41c-0c613da5bf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.735709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a647cf1-d3d0-435e-a41c-0c613da5bf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.737541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a647cf1-d3d0-435e-a41c-0c613da5bf74 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.754187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1034/2078] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:20.758950 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538d1a7-65a9-469d-ad9c-1054c80029da admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.777815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538d1a7-65a9-469d-ad9c-1054c80029da admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.791523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fa95b-adbd-4fd8-a3b7-17f74ce3d4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.792576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fa95b-adbd-4fd8-a3b7-17f74ce3d4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.792893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fa95b-adbd-4fd8-a3b7-17f74ce3d4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.793178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fa95b-adbd-4fd8-a3b7-17f74ce3d4cf admin admin] PATH_INFO: `/v3/projects/05fd7de654d6488f80e6d278deffada4/users/075f6f824aa24104a0187c619accdcd8/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.833773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fa95b-adbd-4fd8-a3b7-17f74ce3d4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fd7de654d6488f80e6d278deffada4, user_id=075f6f824aa24104a0187c619accdcd8, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.836578 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fa95b-adbd-4fd8-a3b7-17f74ce3d4cf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.869244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1045/2079] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:20 2022] PUT /identity/v3/projects/05fd7de654d6488f80e6d278deffada4/users/075f6f824aa24104a0187c619accdcd8/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:20.872579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85859-a5b2-4a1f-be0e-9cabd1d581c0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.872910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85859-a5b2-4a1f-be0e-9cabd1d581c0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.873375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85859-a5b2-4a1f-be0e-9cabd1d581c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.916319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4cf85859-a5b2-4a1f-be0e-9cabd1d581c0 None None] MFA Rules not processed for user `075f6f824aa24104a0187c619accdcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:20.917905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4cf85859-a5b2-4a1f-be0e-9cabd1d581c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:21.008062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1035/2080] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:21.053641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fa95b-adbd-4fd8-a3b7-17f74ce3d4cf admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:21.056163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a97fa95b-adbd-4fd8-a3b7-17f74ce3d4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:21.191925 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fa95b-adbd-4fd8-a3b7-17f74ce3d4cf admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:21.202739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7a0a2-4c04-4b91-b129-90046e2098c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:21.203571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7a0a2-4c04-4b91-b129-90046e2098c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:21.203957 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7a0a2-4c04-4b91-b129-90046e2098c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:21.204365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7a0a2-4c04-4b91-b129-90046e2098c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:21.227442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7a0a2-4c04-4b91-b129-90046e2098c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:21.229093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7a0a2-4c04-4b91-b129-90046e2098c8 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:21.241334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1046/2081] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:22.242184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85859-a5b2-4a1f-be0e-9cabd1d581c0 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:22.243639 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4cf85859-a5b2-4a1f-be0e-9cabd1d581c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:22.258427 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85859-a5b2-4a1f-be0e-9cabd1d581c0 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:22.263551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061d072-f003-4ed8-8288-d02c65a78fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:22.264323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d072-f003-4ed8-8288-d02c65a78fdf service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:22.264915 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d072-f003-4ed8-8288-d02c65a78fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:22.265306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d072-f003-4ed8-8288-d02c65a78fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:22.267403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3061d072-f003-4ed8-8288-d02c65a78fdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:22.319257 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:22.340823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061d072-f003-4ed8-8288-d02c65a78fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:22.342491 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061d072-f003-4ed8-8288-d02c65a78fdf service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:22.352502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1036/2082] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:24.555410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7a0a2-4c04-4b91-b129-90046e2098c8 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:24.557045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-72b7a0a2-4c04-4b91-b129-90046e2098c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:24.659510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7a0a2-4c04-4b91-b129-90046e2098c8 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:24.668650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:24.668650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:24.668650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:24.668650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] PATH_INFO: `/v3/users/ab1fbc1057de4d879f3a30902577adf1` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:24.669177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1fbc1057de4d879f3a30902577adf1)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:24.669303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:24.722232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1fbc1057de4d879f3a30902577adf1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:24.729965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1fbc1057de4d879f3a30902577adf1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:24.730645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1fbc1057de4d879f3a30902577adf1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:24.731297 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1fbc1057de4d879f3a30902577adf1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:24.740022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:24.746125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1fbc1057de4d879f3a30902577adf1'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:24.760254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1047/2083] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:24 2022] DELETE /identity/v3/users/ab1fbc1057de4d879f3a30902577adf1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:24.765681 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f965f6-e539-4c6f-8081-be49380ab1ca None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:24.766191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f965f6-e539-4c6f-8081-be49380ab1ca None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:24.766287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f965f6-e539-4c6f-8081-be49380ab1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:24.785191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-52f965f6-e539-4c6f-8081-be49380ab1ca None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:24.787505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-52f965f6-e539-4c6f-8081-be49380ab1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:24.852357 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1037/2084] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:24.859843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:24.861308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:24.876323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f965f6-e539-4c6f-8081-be49380ab1ca None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:24.877742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-52f965f6-e539-4c6f-8081-be49380ab1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:24.889702 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f965f6-e539-4c6f-8081-be49380ab1ca None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:24.894268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:24.895128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:24.895423 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:24.896036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] PATH_INFO: `/v3/users/52da091338b64c148064489ac4812ea3` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:24.896961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=52da091338b64c148064489ac4812ea3)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:24.898892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:24.922084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfc7ea-dd69-4414-a220-ea5856049776 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:24.926279 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0b78a-2cc0-4021-9e50-3eaaae6aced2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:24.927797 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0b78a-2cc0-4021-9e50-3eaaae6aced2 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:24.928090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0b78a-2cc0-4021-9e50-3eaaae6aced2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:24.928370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0b78a-2cc0-4021-9e50-3eaaae6aced2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:24.938234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0b78a-2cc0-4021-9e50-3eaaae6aced2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:24.939672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0b78a-2cc0-4021-9e50-3eaaae6aced2 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:24.949435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52da091338b64c148064489ac4812ea3'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:24.950092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1048/2085] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:24.956950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52da091338b64c148064489ac4812ea3'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:24.957678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52da091338b64c148064489ac4812ea3'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:24.958564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52da091338b64c148064489ac4812ea3'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:24.970944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52da091338b64c148064489ac4812ea3'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:24.984014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1038/2086] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:24 2022] DELETE /identity/v3/users/52da091338b64c148064489ac4812ea3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:24.988900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f397190-eff2-4702-a5d5-9fce49681da8 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:24.989773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f397190-eff2-4702-a5d5-9fce49681da8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:24.990078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f397190-eff2-4702-a5d5-9fce49681da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:25.007868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4f397190-eff2-4702-a5d5-9fce49681da8 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:25.009122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4f397190-eff2-4702-a5d5-9fce49681da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:25.073210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1049/2087] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:25.084208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:25.085865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:25.184772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1c73f-2789-4703-8e92-4f0f664723fd admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:25.188902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54aeed-5147-4ec5-8ea4-e97a7259069d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:25.189560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54aeed-5147-4ec5-8ea4-e97a7259069d service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:25.189847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54aeed-5147-4ec5-8ea4-e97a7259069d service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:25.190127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54aeed-5147-4ec5-8ea4-e97a7259069d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:25.203740 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:25.206464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54aeed-5147-4ec5-8ea4-e97a7259069d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:25.209279 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54aeed-5147-4ec5-8ea4-e97a7259069d service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:25.225947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1039/2088] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:25.263087 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f397190-eff2-4702-a5d5-9fce49681da8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:25.269733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4f397190-eff2-4702-a5d5-9fce49681da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:25.283138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f397190-eff2-4702-a5d5-9fce49681da8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:25.306124 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:25.307674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:25.308012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:25.308747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] PATH_INFO: `/v3/projects/06ad7855d20c4ad7a2b15ea70e6ec9ab` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:25.309969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ad7855d20c4ad7a2b15ea70e6ec9ab)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:25.312347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:25.376578 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ad7855d20c4ad7a2b15ea70e6ec9ab', 'request_id': 'req-7cbdc358-4840-4e33-a7da-4d8ed5887c17'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.384398 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ad7855d20c4ad7a2b15ea70e6ec9ab', 'request_id': 'req-7cbdc358-4840-4e33-a7da-4d8ed5887c17'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.393862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ad7855d20c4ad7a2b15ea70e6ec9ab', 'request_id': 'req-7cbdc358-4840-4e33-a7da-4d8ed5887c17'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.409187 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] The token cache is being invalidate because project 06ad7855d20c4ad7a2b15ea70e6ec9ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:25.409576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.411714 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.416207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1050/2089] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:25 2022] DELETE /identity/v3/projects/06ad7855d20c4ad7a2b15ea70e6ec9ab => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:25.417601 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54aeed-5147-4ec5-8ea4-e97a7259069d service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:25.431616 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54aeed-5147-4ec5-8ea4-e97a7259069d service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:25.499790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:25.500724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:25.501014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:25.501294 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] PATH_INFO: `/v3/users/7f66a9b8068c4cec95516f45947a5036` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:25.502496 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f66a9b8068c4cec95516f45947a5036)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:25.505308 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:25.555274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f66a9b8068c4cec95516f45947a5036'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.565991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f66a9b8068c4cec95516f45947a5036'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.566683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f66a9b8068c4cec95516f45947a5036'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.567964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f66a9b8068c4cec95516f45947a5036'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.582129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f66a9b8068c4cec95516f45947a5036'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.585516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:25.587379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:25.599608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1040/2090] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:25 2022] DELETE /identity/v3/users/7f66a9b8068c4cec95516f45947a5036 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:25.609323 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdc358-4840-4e33-a7da-4d8ed5887c17 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:25.618502 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:25.714128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:25.715012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:25.715299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:25.715576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] PATH_INFO: `/v3/projects/016fd08eb200468f9f473258047f3102` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:25.716897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016fd08eb200468f9f473258047f3102)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:25.718949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:25.770613 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016fd08eb200468f9f473258047f3102', 'request_id': 'req-4698b9ab-b62f-46e7-9285-9ecfd54efe48'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.776768 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016fd08eb200468f9f473258047f3102', 'request_id': 'req-4698b9ab-b62f-46e7-9285-9ecfd54efe48'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.786941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016fd08eb200468f9f473258047f3102', 'request_id': 'req-4698b9ab-b62f-46e7-9285-9ecfd54efe48'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.802541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] The token cache is being invalidate because project 016fd08eb200468f9f473258047f3102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:25.802846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.803747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.808645 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1051/2091] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:25 2022] DELETE /identity/v3/projects/016fd08eb200468f9f473258047f3102 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:25.810198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:25.812080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:25.833735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5830b7-c078-44c9-8541-b68aa97adc85 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:25.909522 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:25.910744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:25.911658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:25.912056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] PATH_INFO: `/v3/users/fdaee8ad84674549adaa14f6eb9b70ab` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:25.913503 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdaee8ad84674549adaa14f6eb9b70ab)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:25.915548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:25.934122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:25.971074 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdaee8ad84674549adaa14f6eb9b70ab'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.978922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdaee8ad84674549adaa14f6eb9b70ab'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.979677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdaee8ad84674549adaa14f6eb9b70ab'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.980315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdaee8ad84674549adaa14f6eb9b70ab'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:25.993942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdaee8ad84674549adaa14f6eb9b70ab'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.008568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1041/2092] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:25 2022] DELETE /identity/v3/users/fdaee8ad84674549adaa14f6eb9b70ab => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:26.137459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.139090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:26.154603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b9ab-b62f-46e7-9285-9ecfd54efe48 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.222277 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.223266 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.224245 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.224660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] PATH_INFO: `/v3/projects/d9e7cabfadb24e9fb71c4e14fa835aec` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.226150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e7cabfadb24e9fb71c4e14fa835aec)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.228234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.273406 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:26.286507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e7cabfadb24e9fb71c4e14fa835aec', 'request_id': 'req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.296397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e7cabfadb24e9fb71c4e14fa835aec', 'request_id': 'req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.306534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e7cabfadb24e9fb71c4e14fa835aec', 'request_id': 'req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.313579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.314945 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:26.334161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072557ec-a5fe-42c9-bde0-79f6865e0963 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.336602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] The token cache is being invalidate because project d9e7cabfadb24e9fb71c4e14fa835aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:26.337276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.337994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-69db7d9b-7f3f-4f57-8b61-46a2dfee234e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.340847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1052/2093] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:26 2022] DELETE /identity/v3/projects/d9e7cabfadb24e9fb71c4e14fa835aec => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:26.350382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3e5c3-ac38-4bf9-909a-e7032f7d4d11 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.350707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3e5c3-ac38-4bf9-909a-e7032f7d4d11 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.351062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3e5c3-ac38-4bf9-909a-e7032f7d4d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.376050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-54b3e5c3-ac38-4bf9-909a-e7032f7d4d11 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:26.377340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-54b3e5c3-ac38-4bf9-909a-e7032f7d4d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:26.410357 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.411680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.412020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.412307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] PATH_INFO: `/v3/projects/b60c3a0706a84060b356c6eb00d69646` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.414103 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60c3a0706a84060b356c6eb00d69646)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.417073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.480987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1053/2094] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:26.482545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee169-d04e-41ff-ba50-857b546414c2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.482843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee169-d04e-41ff-ba50-857b546414c2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.483132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee169-d04e-41ff-ba50-857b546414c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.489645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60c3a0706a84060b356c6eb00d69646', 'request_id': 'req-50118a89-d6a6-46de-88a1-2af2b444a9a6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.498823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60c3a0706a84060b356c6eb00d69646', 'request_id': 'req-50118a89-d6a6-46de-88a1-2af2b444a9a6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.520174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60c3a0706a84060b356c6eb00d69646', 'request_id': 'req-50118a89-d6a6-46de-88a1-2af2b444a9a6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.534263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c05ee169-d04e-41ff-ba50-857b546414c2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:26.536505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c05ee169-d04e-41ff-ba50-857b546414c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:26.548895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] The token cache is being invalidate because project b60c3a0706a84060b356c6eb00d69646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:26.549532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.551442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.553849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1042/2095] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:26 2022] DELETE /identity/v3/projects/b60c3a0706a84060b356c6eb00d69646 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:26.583046 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.591578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:26.656833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1054/2096] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:26.668026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ee169-d04e-41ff-ba50-857b546414c2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.671503 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:26.679494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ee169-d04e-41ff-ba50-857b546414c2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.685422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcd245-89fd-420d-b63e-1e2fe366681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.686220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcd245-89fd-420d-b63e-1e2fe366681a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.686573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcd245-89fd-420d-b63e-1e2fe366681a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.686927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcd245-89fd-420d-b63e-1e2fe366681a admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.687953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcd245-89fd-420d-b63e-1e2fe366681a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:26.688345 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcd245-89fd-420d-b63e-1e2fe366681a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.690120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcd245-89fd-420d-b63e-1e2fe366681a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.708668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1055/2097] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:26.716281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcd245-89fd-420d-b63e-1e2fe366681a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.746978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcd245-89fd-420d-b63e-1e2fe366681a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.763788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85350a-2d86-4c85-868a-60007872d482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.764462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85350a-2d86-4c85-868a-60007872d482 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.767399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50118a89-d6a6-46de-88a1-2af2b444a9a6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:26.768902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85350a-2d86-4c85-868a-60007872d482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.769205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85350a-2d86-4c85-868a-60007872d482 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.769931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85350a-2d86-4c85-868a-60007872d482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.775659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85350a-2d86-4c85-868a-60007872d482 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.776149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:26.777079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:26.777368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:26.777646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] PATH_INFO: `/v3/users/d1c367cadf7141a99de92d583518c1d5` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:26.779651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c367cadf7141a99de92d583518c1d5)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:26.783120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:26.827358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1056/2098] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:26 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:26.831255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85350a-2d86-4c85-868a-60007872d482 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:26.872913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c367cadf7141a99de92d583518c1d5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.893625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c367cadf7141a99de92d583518c1d5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.894564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c367cadf7141a99de92d583518c1d5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.895223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c367cadf7141a99de92d583518c1d5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.919461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:26.930603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c367cadf7141a99de92d583518c1d5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:26.964994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1043/2099] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:26 2022] DELETE /identity/v3/users/d1c367cadf7141a99de92d583518c1d5 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:26.972136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85350a-2d86-4c85-868a-60007872d482 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:27.127256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecae8e-dd24-440d-b6c4-d4d2a53685d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:27.127975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecae8e-dd24-440d-b6c4-d4d2a53685d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.128255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecae8e-dd24-440d-b6c4-d4d2a53685d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.128536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecae8e-dd24-440d-b6c4-d4d2a53685d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.129329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecae8e-dd24-440d-b6c4-d4d2a53685d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:27.131853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecae8e-dd24-440d-b6c4-d4d2a53685d1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:27.183060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1057/2100] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:26 2022] POST /identity/v3/users => generated 292 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:27.186811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:27.188651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:27.206785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121c64e-697c-427d-a04e-1c128f2a4337 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:27.219207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b5807-473e-44ad-ba0f-5c98f5922e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:27.220499 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b5807-473e-44ad-ba0f-5c98f5922e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.220827 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b5807-473e-44ad-ba0f-5c98f5922e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.221110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b5807-473e-44ad-ba0f-5c98f5922e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.221909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b5807-473e-44ad-ba0f-5c98f5922e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:27.224203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b5807-473e-44ad-ba0f-5c98f5922e93 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:27.244219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1044/2101] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:27.244732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecae8e-dd24-440d-b6c4-d4d2a53685d1 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:27.275275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecae8e-dd24-440d-b6c4-d4d2a53685d1 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:27.281950 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b902ed7-a3e7-4135-b6a4-6d0b8e584254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:27.282754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902ed7-a3e7-4135-b6a4-6d0b8e584254 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.283128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902ed7-a3e7-4135-b6a4-6d0b8e584254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.283545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b902ed7-a3e7-4135-b6a4-6d0b8e584254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.284790 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b902ed7-a3e7-4135-b6a4-6d0b8e584254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:27.288408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b902ed7-a3e7-4135-b6a4-6d0b8e584254 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:27.310271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1058/2102] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:27.310355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b5807-473e-44ad-ba0f-5c98f5922e93 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:27.323761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b5807-473e-44ad-ba0f-5c98f5922e93 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:27.334811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cc94f-8cce-437c-b7bc-95070e8c3d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:27.336032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc94f-8cce-437c-b7bc-95070e8c3d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.336506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc94f-8cce-437c-b7bc-95070e8c3d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.337165 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc94f-8cce-437c-b7bc-95070e8c3d27 admin admin] PATH_INFO: `/v3/projects/9e84049310024814b6b1ea07978b1772/users/271df4f4ba43420ea724330907f9222b/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.368824 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cc94f-8cce-437c-b7bc-95070e8c3d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e84049310024814b6b1ea07978b1772, user_id=271df4f4ba43420ea724330907f9222b, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:27.373035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cc94f-8cce-437c-b7bc-95070e8c3d27 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:27.397490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1045/2103] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:27 2022] PUT /identity/v3/projects/9e84049310024814b6b1ea07978b1772/users/271df4f4ba43420ea724330907f9222b/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:27.407469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f528f-17dd-434d-a70f-ad98a52b4524 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.407761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f528f-17dd-434d-a70f-ad98a52b4524 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.408045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f528f-17dd-434d-a70f-ad98a52b4524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.446995 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7d7f528f-17dd-434d-a70f-ad98a52b4524 None None] MFA Rules not processed for user `271df4f4ba43420ea724330907f9222b`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:27.448670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7d7f528f-17dd-434d-a70f-ad98a52b4524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:27.561462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1059/2104] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:27.565663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cc94f-8cce-437c-b7bc-95070e8c3d27 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:27.593662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f528f-17dd-434d-a70f-ad98a52b4524 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:27.595075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7d7f528f-17dd-434d-a70f-ad98a52b4524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:27.678045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:27.693766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cc94f-8cce-437c-b7bc-95070e8c3d27 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:27.698566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f528f-17dd-434d-a70f-ad98a52b4524 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:27.706275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:27.707658 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.709229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791d679-4530-44a7-9a89-bdf834417291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:27.709751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.710036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] PATH_INFO: `/v3/projects/a81e7e62f8d740898294a4ea80ed243e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.710558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d679-4530-44a7-9a89-bdf834417291 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.710853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d679-4530-44a7-9a89-bdf834417291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.711136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d679-4530-44a7-9a89-bdf834417291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.711367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81e7e62f8d740898294a4ea80ed243e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:27.714480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791d679-4530-44a7-9a89-bdf834417291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:27.715032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:27.717184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791d679-4530-44a7-9a89-bdf834417291 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:27.735770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:27.760234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1046/2105] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:27 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:27.765547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791d679-4530-44a7-9a89-bdf834417291 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:27.785793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81e7e62f8d740898294a4ea80ed243e', 'request_id': 'req-44681f17-ba52-4e20-9a9f-a0d2f47690e3'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:27.796911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81e7e62f8d740898294a4ea80ed243e', 'request_id': 'req-44681f17-ba52-4e20-9a9f-a0d2f47690e3'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:27.816268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81e7e62f8d740898294a4ea80ed243e', 'request_id': 'req-44681f17-ba52-4e20-9a9f-a0d2f47690e3'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:27.834410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] The token cache is being invalidate because project a81e7e62f8d740898294a4ea80ed243e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:27.835091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:27.836184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-44681f17-ba52-4e20-9a9f-a0d2f47690e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:27.838326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1060/2106] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:27 2022] DELETE /identity/v3/projects/a81e7e62f8d740898294a4ea80ed243e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:27.844210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9374-a596-451a-9764-b20ebf2cfdc1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.844523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9374-a596-451a-9764-b20ebf2cfdc1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.844835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9374-a596-451a-9764-b20ebf2cfdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.865816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-77db9374-a596-451a-9764-b20ebf2cfdc1 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:27.867081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-77db9374-a596-451a-9764-b20ebf2cfdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:27.881857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791d679-4530-44a7-9a89-bdf834417291 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:27.938473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1061/2107] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:27.947511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63094e8-b7c1-49db-934f-cbe571e7d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:27.948192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63094e8-b7c1-49db-934f-cbe571e7d142 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.948478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63094e8-b7c1-49db-934f-cbe571e7d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.948583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eae88a-793f-41e8-9710-39c0eb42b4b2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.948788 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63094e8-b7c1-49db-934f-cbe571e7d142 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.948889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eae88a-793f-41e8-9710-39c0eb42b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.949152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eae88a-793f-41e8-9710-39c0eb42b4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.949482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63094e8-b7c1-49db-934f-cbe571e7d142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:27.951403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63094e8-b7c1-49db-934f-cbe571e7d142 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:27.969284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-41eae88a-793f-41e8-9710-39c0eb42b4b2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:27.970618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-41eae88a-793f-41e8-9710-39c0eb42b4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:27.976147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1047/2108] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:27 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:27.979733 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1062/2109] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:27.979969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63094e8-b7c1-49db-934f-cbe571e7d142 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:27.981537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a63094e8-b7c1-49db-934f-cbe571e7d142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:27.983651 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eae88a-793f-41e8-9710-39c0eb42b4b2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:27.993402 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eae88a-793f-41e8-9710-39c0eb42b4b2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:27.993643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63094e8-b7c1-49db-934f-cbe571e7d142 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:27.998009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0744c-bc98-4d9f-a4cd-509e81ae0ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:27.998351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f6ffe-d6c7-45af-9b47-ee6d97fb8f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:27.998683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0744c-bc98-4d9f-a4cd-509e81ae0ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.998968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0744c-bc98-4d9f-a4cd-509e81ae0ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.999086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6ffe-d6c7-45af-9b47-ee6d97fb8f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:27.999243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0744c-bc98-4d9f-a4cd-509e81ae0ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.999340 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6ffe-d6c7-45af-9b47-ee6d97fb8f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:27.999544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6ffe-d6c7-45af-9b47-ee6d97fb8f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:27.999966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0744c-bc98-4d9f-a4cd-509e81ae0ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:28.000272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0744c-bc98-4d9f-a4cd-509e81ae0ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.000368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f6ffe-d6c7-45af-9b47-ee6d97fb8f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.001908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0744c-bc98-4d9f-a4cd-509e81ae0ffe admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.002017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f6ffe-d6c7-45af-9b47-ee6d97fb8f91 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.013380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1048/2110] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:28.016675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1063/2111] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:14:28.017353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f6ffe-d6c7-45af-9b47-ee6d97fb8f91 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.018741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0744c-bc98-4d9f-a4cd-509e81ae0ffe admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.029025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0744c-bc98-4d9f-a4cd-509e81ae0ffe admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.029308 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f6ffe-d6c7-45af-9b47-ee6d97fb8f91 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.033624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec413c-90ea-4566-b8b0-cac3e7c80ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.033853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d122865-d27b-4ee0-b57f-2db5310512ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.034257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec413c-90ea-4566-b8b0-cac3e7c80ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.034542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec413c-90ea-4566-b8b0-cac3e7c80ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.034708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d122865-d27b-4ee0-b57f-2db5310512ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.034804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec413c-90ea-4566-b8b0-cac3e7c80ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.034993 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d122865-d27b-4ee0-b57f-2db5310512ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.035271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d122865-d27b-4ee0-b57f-2db5310512ba admin admin] PATH_INFO: `/v3/projects/deddcf50eec349f489904bbcb439ca58/users/e59efb694f9547a3a614ce68b181ebac/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.035740 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec413c-90ea-4566-b8b0-cac3e7c80ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.037820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec413c-90ea-4566-b8b0-cac3e7c80ef3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.051023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d122865-d27b-4ee0-b57f-2db5310512ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=deddcf50eec349f489904bbcb439ca58, user_id=e59efb694f9547a3a614ce68b181ebac, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.053832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d122865-d27b-4ee0-b57f-2db5310512ba admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.065331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1064/2112] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:28 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:28.070154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec413c-90ea-4566-b8b0-cac3e7c80ef3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.071554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1049/2113] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:28 2022] PUT /identity/v3/projects/deddcf50eec349f489904bbcb439ca58/users/e59efb694f9547a3a614ce68b181ebac/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:28.075040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d122865-d27b-4ee0-b57f-2db5310512ba admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.116758 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:28.135629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:28.137739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec413c-90ea-4566-b8b0-cac3e7c80ef3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.142967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d122865-d27b-4ee0-b57f-2db5310512ba admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.143813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e0653-52fc-4e7b-bbbf-35033d54d925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.144474 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e0653-52fc-4e7b-bbbf-35033d54d925 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.144800 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e0653-52fc-4e7b-bbbf-35033d54d925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.145083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e0653-52fc-4e7b-bbbf-35033d54d925 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.145971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e0653-52fc-4e7b-bbbf-35033d54d925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.148088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e0653-52fc-4e7b-bbbf-35033d54d925 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.148671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fc1e4-9e6b-4342-9293-f81586fdcf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.149334 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fc1e4-9e6b-4342-9293-f81586fdcf82 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.149619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fc1e4-9e6b-4342-9293-f81586fdcf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.149894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fc1e4-9e6b-4342-9293-f81586fdcf82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.150619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fc1e4-9e6b-4342-9293-f81586fdcf82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.152205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fc1e4-9e6b-4342-9293-f81586fdcf82 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.165054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1050/2114] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:28.169541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fc1e4-9e6b-4342-9293-f81586fdcf82 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.174153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1065/2115] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:28 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:28.175387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e0653-52fc-4e7b-bbbf-35033d54d925 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.180704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fc1e4-9e6b-4342-9293-f81586fdcf82 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.185295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb2b5c-20ca-432a-8927-6518bebb822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.186066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e0653-52fc-4e7b-bbbf-35033d54d925 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.186172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2b5c-20ca-432a-8927-6518bebb822d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.186428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2b5c-20ca-432a-8927-6518bebb822d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.186706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2b5c-20ca-432a-8927-6518bebb822d admin admin] PATH_INFO: `/v3/projects/deddcf50eec349f489904bbcb439ca58/users/e59efb694f9547a3a614ce68b181ebac/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.188718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb2b5c-20ca-432a-8927-6518bebb822d admin admin] RBAC: Authorizing `identity:create_grant(project_id=deddcf50eec349f489904bbcb439ca58, user_id=e59efb694f9547a3a614ce68b181ebac, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.190669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba7ef8-c21a-49a1-b9d4-197f358a63a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.191314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba7ef8-c21a-49a1-b9d4-197f358a63a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.191416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb2b5c-20ca-432a-8927-6518bebb822d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.191601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba7ef8-c21a-49a1-b9d4-197f358a63a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.191908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba7ef8-c21a-49a1-b9d4-197f358a63a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.192731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba7ef8-c21a-49a1-b9d4-197f358a63a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.194334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba7ef8-c21a-49a1-b9d4-197f358a63a9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.202667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1051/2116] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:28 2022] PUT /identity/v3/projects/deddcf50eec349f489904bbcb439ca58/users/e59efb694f9547a3a614ce68b181ebac/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:28.208445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1066/2117] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:28.212971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb2b5c-20ca-432a-8927-6518bebb822d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.216514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf2a1-4ede-4caa-875d-ad1fdc6d4550 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.216954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf2a1-4ede-4caa-875d-ad1fdc6d4550 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.217344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf2a1-4ede-4caa-875d-ad1fdc6d4550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.247491 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8a8cf2a1-4ede-4caa-875d-ad1fdc6d4550 None None] MFA Rules not processed for user `e59efb694f9547a3a614ce68b181ebac`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:28.248736 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8a8cf2a1-4ede-4caa-875d-ad1fdc6d4550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:28.278850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb2b5c-20ca-432a-8927-6518bebb822d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.283570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20105abd-d5a2-4ea4-9512-706995640e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.284268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20105abd-d5a2-4ea4-9512-706995640e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.284578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20105abd-d5a2-4ea4-9512-706995640e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.284896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20105abd-d5a2-4ea4-9512-706995640e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.285934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20105abd-d5a2-4ea4-9512-706995640e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.288189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20105abd-d5a2-4ea4-9512-706995640e2f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.298921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1052/2118] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:28.303150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20105abd-d5a2-4ea4-9512-706995640e2f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.313225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20105abd-d5a2-4ea4-9512-706995640e2f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.318519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43451da-c79d-4d84-8c49-903a0484c51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.319398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43451da-c79d-4d84-8c49-903a0484c51d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.319731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43451da-c79d-4d84-8c49-903a0484c51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.320007 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43451da-c79d-4d84-8c49-903a0484c51d admin admin] PATH_INFO: `/v3/projects/ec134f3bbdc342f0a8424c59a385d73f/users/187bf0377c494cfea608ab9fe045a9fe/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.321283 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1067/2119] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:28.333615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cf2a1-4ede-4caa-875d-ad1fdc6d4550 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.335438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8a8cf2a1-4ede-4caa-875d-ad1fdc6d4550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:28.337691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43451da-c79d-4d84-8c49-903a0484c51d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec134f3bbdc342f0a8424c59a385d73f, user_id=187bf0377c494cfea608ab9fe045a9fe, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.340629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43451da-c79d-4d84-8c49-903a0484c51d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.359716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1053/2120] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:28 2022] PUT /identity/v3/projects/ec134f3bbdc342f0a8424c59a385d73f/users/187bf0377c494cfea608ab9fe045a9fe/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:28.372377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a45dfc-858f-4bf7-ac03-622695c8c0f4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.372775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a45dfc-858f-4bf7-ac03-622695c8c0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.373227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a45dfc-858f-4bf7-ac03-622695c8c0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.404060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-70a45dfc-858f-4bf7-ac03-622695c8c0f4 None None] MFA Rules not processed for user `187bf0377c494cfea608ab9fe045a9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:28.406314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-70a45dfc-858f-4bf7-ac03-622695c8c0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:28.416153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cf2a1-4ede-4caa-875d-ad1fdc6d4550 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.475475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be384a-934a-4e7c-94db-367c42d8e8ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.476133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be384a-934a-4e7c-94db-367c42d8e8ae service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.476415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be384a-934a-4e7c-94db-367c42d8e8ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.476722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be384a-934a-4e7c-94db-367c42d8e8ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.491041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:28.496188 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1054/2121] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:28.498291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a45dfc-858f-4bf7-ac03-622695c8c0f4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.554456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be384a-934a-4e7c-94db-367c42d8e8ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.555831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be384a-934a-4e7c-94db-367c42d8e8ae service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.566879 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1068/2122] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:28.576350 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:28.605282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a45dfc-858f-4bf7-ac03-622695c8c0f4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.611707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24630c45-3d33-4ddc-89b7-b812e51603e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.612533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630c45-3d33-4ddc-89b7-b812e51603e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.612896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630c45-3d33-4ddc-89b7-b812e51603e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.613180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630c45-3d33-4ddc-89b7-b812e51603e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.613919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24630c45-3d33-4ddc-89b7-b812e51603e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.616226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24630c45-3d33-4ddc-89b7-b812e51603e3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.653698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1055/2123] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:28 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:28.657602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be384a-934a-4e7c-94db-367c42d8e8ae service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.669322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be384a-934a-4e7c-94db-367c42d8e8ae service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.735564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685b0f-f7a9-4c1b-8f72-4bc807aad84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.736243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685b0f-f7a9-4c1b-8f72-4bc807aad84c admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.736743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685b0f-f7a9-4c1b-8f72-4bc807aad84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.737032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685b0f-f7a9-4c1b-8f72-4bc807aad84c admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.738438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685b0f-f7a9-4c1b-8f72-4bc807aad84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.741132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685b0f-f7a9-4c1b-8f72-4bc807aad84c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.765235 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1069/2124] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:28 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:28.766408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24630c45-3d33-4ddc-89b7-b812e51603e3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.777475 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24630c45-3d33-4ddc-89b7-b812e51603e3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.782575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a920d46-580d-4f18-93ac-1d7515634e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.783365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920d46-580d-4f18-93ac-1d7515634e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.783572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920d46-580d-4f18-93ac-1d7515634e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.783850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920d46-580d-4f18-93ac-1d7515634e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.784582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a920d46-580d-4f18-93ac-1d7515634e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.787163 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a920d46-580d-4f18-93ac-1d7515634e73 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.801150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1056/2125] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:28.805529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685b0f-f7a9-4c1b-8f72-4bc807aad84c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.815817 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685b0f-f7a9-4c1b-8f72-4bc807aad84c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.821241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf8df-1d3d-4190-93e8-eb7ab3bc6efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.822081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf8df-1d3d-4190-93e8-eb7ab3bc6efd admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.822501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf8df-1d3d-4190-93e8-eb7ab3bc6efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.822928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf8df-1d3d-4190-93e8-eb7ab3bc6efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.823793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caf8df-1d3d-4190-93e8-eb7ab3bc6efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.825519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caf8df-1d3d-4190-93e8-eb7ab3bc6efd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.837278 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1070/2126] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:28.841587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a920d46-580d-4f18-93ac-1d7515634e73 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:28.857770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a920d46-580d-4f18-93ac-1d7515634e73 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:28.863907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58711204-fc4d-49cc-87d0-0068c719349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:28.866026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58711204-fc4d-49cc-87d0-0068c719349c admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.866026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58711204-fc4d-49cc-87d0-0068c719349c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.866379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58711204-fc4d-49cc-87d0-0068c719349c admin admin] PATH_INFO: `/v3/projects/1e78f406a72f49f480308af2501cfe53/users/19de1690c4754f06978d392c9e23514b/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.889734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58711204-fc4d-49cc-87d0-0068c719349c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e78f406a72f49f480308af2501cfe53, user_id=19de1690c4754f06978d392c9e23514b, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:28.897342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58711204-fc4d-49cc-87d0-0068c719349c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:28.920218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1057/2127] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:28 2022] PUT /identity/v3/projects/1e78f406a72f49f480308af2501cfe53/users/19de1690c4754f06978d392c9e23514b/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:28.938183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24de152-b4d6-4faa-b4d7-5d74287cf27e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:28.938668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24de152-b4d6-4faa-b4d7-5d74287cf27e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:28.939196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24de152-b4d6-4faa-b4d7-5d74287cf27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:28.989049 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a24de152-b4d6-4faa-b4d7-5d74287cf27e None None] MFA Rules not processed for user `19de1690c4754f06978d392c9e23514b`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:28.990284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a24de152-b4d6-4faa-b4d7-5d74287cf27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:29.077816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1071/2128] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:29.084499 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58711204-fc4d-49cc-87d0-0068c719349c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.171218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58711204-fc4d-49cc-87d0-0068c719349c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.179418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4665-22e2-4e70-98f6-5b3e4fb54f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.180802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4665-22e2-4e70-98f6-5b3e4fb54f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.180802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4665-22e2-4e70-98f6-5b3e4fb54f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.180802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4665-22e2-4e70-98f6-5b3e4fb54f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.182471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d4665-22e2-4e70-98f6-5b3e4fb54f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.183655 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d4665-22e2-4e70-98f6-5b3e4fb54f8b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.226685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1058/2129] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:29 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:29.230867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24de152-b4d6-4faa-b4d7-5d74287cf27e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.245168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24de152-b4d6-4faa-b4d7-5d74287cf27e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.264932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4665-22e2-4e70-98f6-5b3e4fb54f8b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.272815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:29.325942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcf5b4-01b8-4cdd-97ae-c365ff4e4fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.326525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcf5b4-01b8-4cdd-97ae-c365ff4e4fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.326812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcf5b4-01b8-4cdd-97ae-c365ff4e4fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.327091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcf5b4-01b8-4cdd-97ae-c365ff4e4fdd admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.327797 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcf5b4-01b8-4cdd-97ae-c365ff4e4fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.329776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcf5b4-01b8-4cdd-97ae-c365ff4e4fdd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.354372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1072/2130] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:29 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:29.354569 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4665-22e2-4e70-98f6-5b3e4fb54f8b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.355488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcf5b4-01b8-4cdd-97ae-c365ff4e4fdd admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.359346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7733e0b-eecb-4041-8cdc-d6c6ddd5c520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.360559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7733e0b-eecb-4041-8cdc-d6c6ddd5c520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.360936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7733e0b-eecb-4041-8cdc-d6c6ddd5c520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.361226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7733e0b-eecb-4041-8cdc-d6c6ddd5c520 admin admin] PATH_INFO: `/v3/users/271df4f4ba43420ea724330907f9222b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.363572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7733e0b-eecb-4041-8cdc-d6c6ddd5c520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271df4f4ba43420ea724330907f9222b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.365384 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcf5b4-01b8-4cdd-97ae-c365ff4e4fdd admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.366041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7733e0b-eecb-4041-8cdc-d6c6ddd5c520 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.370450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29282cf-c63d-40e3-9051-f740eb23b351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.371126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29282cf-c63d-40e3-9051-f740eb23b351 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.371412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29282cf-c63d-40e3-9051-f740eb23b351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.371692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29282cf-c63d-40e3-9051-f740eb23b351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.372607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29282cf-c63d-40e3-9051-f740eb23b351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.374464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29282cf-c63d-40e3-9051-f740eb23b351 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.383952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:29.387040 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1073/2131] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:29.391399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29282cf-c63d-40e3-9051-f740eb23b351 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.405622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29282cf-c63d-40e3-9051-f740eb23b351 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.412392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4f28c-5125-4645-898d-1e49a1a78ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.413394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4f28c-5125-4645-898d-1e49a1a78ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.413701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4f28c-5125-4645-898d-1e49a1a78ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.413957 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4f28c-5125-4645-898d-1e49a1a78ca3 admin admin] PATH_INFO: `/v3/projects/8fa061d8bb3344aba96a6016dc5b1cc7/users/e99808a241034dbf97d9f2c5a8fe7230/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.431202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b7733e0b-eecb-4041-8cdc-d6c6ddd5c520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271df4f4ba43420ea724330907f9222b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:29.433630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4f28c-5125-4645-898d-1e49a1a78ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa061d8bb3344aba96a6016dc5b1cc7, user_id=e99808a241034dbf97d9f2c5a8fe7230, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.437016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4f28c-5125-4645-898d-1e49a1a78ca3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.448771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b7733e0b-eecb-4041-8cdc-d6c6ddd5c520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271df4f4ba43420ea724330907f9222b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:29.448771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b7733e0b-eecb-4041-8cdc-d6c6ddd5c520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271df4f4ba43420ea724330907f9222b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:29.449447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b7733e0b-eecb-4041-8cdc-d6c6ddd5c520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271df4f4ba43420ea724330907f9222b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:29.461285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1074/2132] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:29 2022] PUT /identity/v3/projects/8fa061d8bb3344aba96a6016dc5b1cc7/users/e99808a241034dbf97d9f2c5a8fe7230/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:29.465116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b7733e0b-eecb-4041-8cdc-d6c6ddd5c520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271df4f4ba43420ea724330907f9222b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:29.468819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4f28c-5125-4645-898d-1e49a1a78ca3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.470541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-07c4f28c-5125-4645-898d-1e49a1a78ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:29.479550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1059/2133] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:29 2022] DELETE /identity/v3/users/271df4f4ba43420ea724330907f9222b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:29.484792 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164b5ae-a231-4602-9714-4706f15c4856 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.485119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164b5ae-a231-4602-9714-4706f15c4856 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.485415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164b5ae-a231-4602-9714-4706f15c4856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.503835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2164b5ae-a231-4602-9714-4706f15c4856 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:29.506074 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2164b5ae-a231-4602-9714-4706f15c4856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:29.566626 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4f28c-5125-4645-898d-1e49a1a78ca3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.593361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1060/2134] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:29.607969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164b5ae-a231-4602-9714-4706f15c4856 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.611160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2164b5ae-a231-4602-9714-4706f15c4856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:29.652534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb81cf-aeb3-4306-bbf4-022f5993048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.654112 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb81cf-aeb3-4306-bbf4-022f5993048a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.654112 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb81cf-aeb3-4306-bbf4-022f5993048a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.654288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb81cf-aeb3-4306-bbf4-022f5993048a admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.655183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb81cf-aeb3-4306-bbf4-022f5993048a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.658119 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb81cf-aeb3-4306-bbf4-022f5993048a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.670301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1075/2135] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:29.674416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb81cf-aeb3-4306-bbf4-022f5993048a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.685752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb81cf-aeb3-4306-bbf4-022f5993048a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.686901 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164b5ae-a231-4602-9714-4706f15c4856 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:29.690818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7240f-6614-4939-8459-5a9c3011c718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.691535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2557d-51b6-47ad-89a8-af3cd7c22763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:29.691663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7240f-6614-4939-8459-5a9c3011c718 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.692196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7240f-6614-4939-8459-5a9c3011c718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.693098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7240f-6614-4939-8459-5a9c3011c718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.693607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2557d-51b6-47ad-89a8-af3cd7c22763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.693890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2557d-51b6-47ad-89a8-af3cd7c22763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.694263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2557d-51b6-47ad-89a8-af3cd7c22763 admin admin] PATH_INFO: `/v3/projects/8fa061d8bb3344aba96a6016dc5b1cc7/users/e99808a241034dbf97d9f2c5a8fe7230/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.696577 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2557d-51b6-47ad-89a8-af3cd7c22763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa061d8bb3344aba96a6016dc5b1cc7, user_id=e99808a241034dbf97d9f2c5a8fe7230, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.699285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2557d-51b6-47ad-89a8-af3cd7c22763 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.719954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1076/2136] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:29 2022] PUT /identity/v3/projects/8fa061d8bb3344aba96a6016dc5b1cc7/users/e99808a241034dbf97d9f2c5a8fe7230/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:29.733482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7240f-6614-4939-8459-5a9c3011c718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:29.733482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7240f-6614-4939-8459-5a9c3011c718 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:29.737081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c76521-ad05-4501-90cc-dc7096f9b15b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:29.737546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c76521-ad05-4501-90cc-dc7096f9b15b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:29.737642 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c76521-ad05-4501-90cc-dc7096f9b15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:29.740456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1061/2137] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:29.749527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:29.775087 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-76c76521-ad05-4501-90cc-dc7096f9b15b None None] MFA Rules not processed for user `e99808a241034dbf97d9f2c5a8fe7230`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:29.776655 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-76c76521-ad05-4501-90cc-dc7096f9b15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:29.857454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1077/2138] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:29.870198 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7240f-6614-4939-8459-5a9c3011c718 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:29.871610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f6a7240f-6614-4939-8459-5a9c3011c718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:29.928301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:29.956798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7240f-6614-4939-8459-5a9c3011c718 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:30.081622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4b6c3-fd9a-4fc8-9ca7-3b181f739a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:30.082299 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b6c3-fd9a-4fc8-9ca7-3b181f739a8a service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.082585 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b6c3-fd9a-4fc8-9ca7-3b181f739a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.083091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4b6c3-fd9a-4fc8-9ca7-3b181f739a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.085085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f9c4b6c3-fd9a-4fc8-9ca7-3b181f739a8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:30.168117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4b6c3-fd9a-4fc8-9ca7-3b181f739a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:30.169877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4b6c3-fd9a-4fc8-9ca7-3b181f739a8a service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.184768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1062/2139] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:30.258385 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c76521-ad05-4501-90cc-dc7096f9b15b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:30.260054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-76c76521-ad05-4501-90cc-dc7096f9b15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:30.357844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c76521-ad05-4501-90cc-dc7096f9b15b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:30.365439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:30.366337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.366624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.367156 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] PATH_INFO: `/v3/projects/9e84049310024814b6b1ea07978b1772` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.368313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e84049310024814b6b1ea07978b1772)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:30.370835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.421900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e84049310024814b6b1ea07978b1772', 'request_id': 'req-6c5becca-34c8-460a-b150-cd58a3152807'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.430317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e84049310024814b6b1ea07978b1772', 'request_id': 'req-6c5becca-34c8-460a-b150-cd58a3152807'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.440009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e84049310024814b6b1ea07978b1772', 'request_id': 'req-6c5becca-34c8-460a-b150-cd58a3152807'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.452839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] The token cache is being invalidate because project 9e84049310024814b6b1ea07978b1772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:30.453128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.453796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.457660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1078/2140] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:30 2022] DELETE /identity/v3/projects/9e84049310024814b6b1ea07978b1772 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:30.460098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4b6c3-fd9a-4fc8-9ca7-3b181f739a8a service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:30.473168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4b6c3-fd9a-4fc8-9ca7-3b181f739a8a service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:30.567823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce60e5e-16a1-4633-ac47-a5033d3fe70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:30.569172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce60e5e-16a1-4633-ac47-a5033d3fe70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:30.569489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce60e5e-16a1-4633-ac47-a5033d3fe70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:30.570323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce60e5e-16a1-4633-ac47-a5033d3fe70f admin admin] PATH_INFO: `/v3/users/e59efb694f9547a3a614ce68b181ebac` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:30.571597 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce60e5e-16a1-4633-ac47-a5033d3fe70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59efb694f9547a3a614ce68b181ebac)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:30.573750 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce60e5e-16a1-4633-ac47-a5033d3fe70f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:30.661681 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8ce60e5e-16a1-4633-ac47-a5033d3fe70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59efb694f9547a3a614ce68b181ebac'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.665185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:30.673968 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8ce60e5e-16a1-4633-ac47-a5033d3fe70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59efb694f9547a3a614ce68b181ebac'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.675234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8ce60e5e-16a1-4633-ac47-a5033d3fe70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59efb694f9547a3a614ce68b181ebac'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.677529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8ce60e5e-16a1-4633-ac47-a5033d3fe70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59efb694f9547a3a614ce68b181ebac'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.696465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8ce60e5e-16a1-4633-ac47-a5033d3fe70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59efb694f9547a3a614ce68b181ebac'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:30.712927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1063/2141] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:30 2022] DELETE /identity/v3/users/e59efb694f9547a3a614ce68b181ebac => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:31.008038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.009636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.025072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5becca-34c8-460a-b150-cd58a3152807 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.057611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:31.111134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.112153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.112543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.112963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] PATH_INFO: `/v3/projects/deddcf50eec349f489904bbcb439ca58` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.114904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] RBAC: Authorizing `identity:delete_project(project_id=deddcf50eec349f489904bbcb439ca58)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.117391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.214425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deddcf50eec349f489904bbcb439ca58', 'request_id': 'req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:31.229933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deddcf50eec349f489904bbcb439ca58', 'request_id': 'req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:31.253021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deddcf50eec349f489904bbcb439ca58', 'request_id': 'req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:31.267173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] The token cache is being invalidate because project deddcf50eec349f489904bbcb439ca58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:31.267564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:31.268373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f4a55d2c-a88a-4c64-b6e1-7e4ad01a011d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:31.271484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1079/2142] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:31 2022] DELETE /identity/v3/projects/deddcf50eec349f489904bbcb439ca58 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:31.281877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ed88-fc95-43d2-abab-4e94d9814272 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.282369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ed88-fc95-43d2-abab-4e94d9814272 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.282457 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ed88-fc95-43d2-abab-4e94d9814272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.311527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3025ed88-fc95-43d2-abab-4e94d9814272 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:31.318932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3025ed88-fc95-43d2-abab-4e94d9814272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.398466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1064/2143] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:31.407866 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4662-480c-439a-93ac-3ef8039547d8 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.408201 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4662-480c-439a-93ac-3ef8039547d8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.408496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4662-480c-439a-93ac-3ef8039547d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.428720 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-db8a4662-480c-439a-93ac-3ef8039547d8 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:31.430095 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-db8a4662-480c-439a-93ac-3ef8039547d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.439080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1080/2144] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:31.444274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025ed88-fc95-43d2-abab-4e94d9814272 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.453908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025ed88-fc95-43d2-abab-4e94d9814272 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.460199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21227816-3feb-4b6b-8461-c2fdad90bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.460987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227816-3feb-4b6b-8461-c2fdad90bb7a admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.461310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227816-3feb-4b6b-8461-c2fdad90bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.461667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227816-3feb-4b6b-8461-c2fdad90bb7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.462487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21227816-3feb-4b6b-8461-c2fdad90bb7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:31.462834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21227816-3feb-4b6b-8461-c2fdad90bb7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.464665 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21227816-3feb-4b6b-8461-c2fdad90bb7a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.478159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1065/2145] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:31.482633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a4662-480c-439a-93ac-3ef8039547d8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.494056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a4662-480c-439a-93ac-3ef8039547d8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.498845 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcc961-2bf9-4b51-8fa4-7349bd3c50dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.499525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcc961-2bf9-4b51-8fa4-7349bd3c50dc admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.499807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcc961-2bf9-4b51-8fa4-7349bd3c50dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.500081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcc961-2bf9-4b51-8fa4-7349bd3c50dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.500937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcc961-2bf9-4b51-8fa4-7349bd3c50dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.502849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcc961-2bf9-4b51-8fa4-7349bd3c50dc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.528551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1081/2146] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:31 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:31.533263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21227816-3feb-4b6b-8461-c2fdad90bb7a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.544389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21227816-3feb-4b6b-8461-c2fdad90bb7a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.603703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cba64-c56a-4fe5-bc06-dfc7a419fefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.604370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cba64-c56a-4fe5-bc06-dfc7a419fefc admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.604691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cba64-c56a-4fe5-bc06-dfc7a419fefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.604975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cba64-c56a-4fe5-bc06-dfc7a419fefc admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.605709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cba64-c56a-4fe5-bc06-dfc7a419fefc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.607585 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cba64-c56a-4fe5-bc06-dfc7a419fefc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.639215 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1066/2147] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:31 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:31.643372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcc961-2bf9-4b51-8fa4-7349bd3c50dc admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.659863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcc961-2bf9-4b51-8fa4-7349bd3c50dc admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.666014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6393bb5-e22d-4397-9bbe-54a7c58a9b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.666730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6393bb5-e22d-4397-9bbe-54a7c58a9b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.667029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6393bb5-e22d-4397-9bbe-54a7c58a9b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.667314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6393bb5-e22d-4397-9bbe-54a7c58a9b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.668116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6393bb5-e22d-4397-9bbe-54a7c58a9b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.669846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6393bb5-e22d-4397-9bbe-54a7c58a9b44 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.682045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1082/2148] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:31.686203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cba64-c56a-4fe5-bc06-dfc7a419fefc admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.696439 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cba64-c56a-4fe5-bc06-dfc7a419fefc admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.702176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22257b4c-f856-4b67-835e-aaf4a6c5a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.703043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257b4c-f856-4b67-835e-aaf4a6c5a632 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.703434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257b4c-f856-4b67-835e-aaf4a6c5a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.703720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257b4c-f856-4b67-835e-aaf4a6c5a632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.704533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22257b4c-f856-4b67-835e-aaf4a6c5a632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.706224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22257b4c-f856-4b67-835e-aaf4a6c5a632 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.716895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1067/2149] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:31.723109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6393bb5-e22d-4397-9bbe-54a7c58a9b44 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.733700 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6393bb5-e22d-4397-9bbe-54a7c58a9b44 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.738479 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c252a-20f8-4dca-b7fd-f2f37c269ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.740196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c252a-20f8-4dca-b7fd-f2f37c269ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.740487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c252a-20f8-4dca-b7fd-f2f37c269ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.740804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c252a-20f8-4dca-b7fd-f2f37c269ea6 admin admin] PATH_INFO: `/v3/projects/86db0de5e0ae4c1197a7662cb71bf9af/users/e6413e4d77064c48a8ecffda215679ad/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.757954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c252a-20f8-4dca-b7fd-f2f37c269ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86db0de5e0ae4c1197a7662cb71bf9af, user_id=e6413e4d77064c48a8ecffda215679ad, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.760881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c252a-20f8-4dca-b7fd-f2f37c269ea6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.777727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1083/2150] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:31 2022] PUT /identity/v3/projects/86db0de5e0ae4c1197a7662cb71bf9af/users/e6413e4d77064c48a8ecffda215679ad/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:31.788713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7351a-23f5-45de-953d-de8f4480e182 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.789015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7351a-23f5-45de-953d-de8f4480e182 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.789299 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7351a-23f5-45de-953d-de8f4480e182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.816374 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8cf7351a-23f5-45de-953d-de8f4480e182 None None] MFA Rules not processed for user `e6413e4d77064c48a8ecffda215679ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:31.817596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c252a-20f8-4dca-b7fd-f2f37c269ea6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.818401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8cf7351a-23f5-45de-953d-de8f4480e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.819517 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-de0c252a-20f8-4dca-b7fd-f2f37c269ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.839719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:31.875299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:31.885900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c252a-20f8-4dca-b7fd-f2f37c269ea6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.890478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22044ac-3e37-4cf0-8965-aa758a66159f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.891170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22044ac-3e37-4cf0-8965-aa758a66159f service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.891504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22044ac-3e37-4cf0-8965-aa758a66159f service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.891822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22044ac-3e37-4cf0-8965-aa758a66159f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.893204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1068/2151] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:31.893691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f22044ac-3e37-4cf0-8965-aa758a66159f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.904247 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7351a-23f5-45de-953d-de8f4480e182 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.905928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8cf7351a-23f5-45de-953d-de8f4480e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.957299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22044ac-3e37-4cf0-8965-aa758a66159f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.959170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22044ac-3e37-4cf0-8965-aa758a66159f service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.967402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7351a-23f5-45de-953d-de8f4480e182 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.969062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1084/2152] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:31.974019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac28e1-3e74-4773-810b-19aa2d245242 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3780488ee9404b3b8eda52acf8dceca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.974671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac28e1-3e74-4773-810b-19aa2d245242 service glance] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.974947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac28e1-3e74-4773-810b-19aa2d245242 service glance] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.975228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac28e1-3e74-4773-810b-19aa2d245242 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.984550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac28e1-3e74-4773-810b-19aa2d245242 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.986080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac28e1-3e74-4773-810b-19aa2d245242 service glance] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.996728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1069/2153] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:32.524278 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22044ac-3e37-4cf0-8965-aa758a66159f service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.526170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f22044ac-3e37-4cf0-8965-aa758a66159f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:32.649997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22044ac-3e37-4cf0-8965-aa758a66159f service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.664878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ff981-2c93-4068-be65-9de90d0f8e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.664878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff981-2c93-4068-be65-9de90d0f8e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.664878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff981-2c93-4068-be65-9de90d0f8e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.664878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff981-2c93-4068-be65-9de90d0f8e25 admin admin] PATH_INFO: `/v3/users/075f6f824aa24104a0187c619accdcd8` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.665256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ff981-2c93-4068-be65-9de90d0f8e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=075f6f824aa24104a0187c619accdcd8)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.665256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ff981-2c93-4068-be65-9de90d0f8e25 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.716389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac28e1-3e74-4773-810b-19aa2d245242 service glance] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.734050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac28e1-3e74-4773-810b-19aa2d245242 service glance] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.742568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3ad7f-c9a9-407a-9619-84e7e7ea7154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:32.751257 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3ad7f-c9a9-407a-9619-84e7e7ea7154 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.751658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3ad7f-c9a9-407a-9619-84e7e7ea7154 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.752062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3ad7f-c9a9-407a-9619-84e7e7ea7154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.754271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-dbd3ad7f-c9a9-407a-9619-84e7e7ea7154 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:32.769762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-be5ff981-2c93-4068-be65-9de90d0f8e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075f6f824aa24104a0187c619accdcd8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:32.785748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-be5ff981-2c93-4068-be65-9de90d0f8e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075f6f824aa24104a0187c619accdcd8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:32.787340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-be5ff981-2c93-4068-be65-9de90d0f8e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075f6f824aa24104a0187c619accdcd8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:32.788082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-be5ff981-2c93-4068-be65-9de90d0f8e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075f6f824aa24104a0187c619accdcd8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:32.801300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-be5ff981-2c93-4068-be65-9de90d0f8e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075f6f824aa24104a0187c619accdcd8'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:32.816853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1085/2154] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:32 2022] DELETE /identity/v3/users/075f6f824aa24104a0187c619accdcd8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:32.821668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea244-146b-48e7-94e5-d751f5935ea6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:32.821964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea244-146b-48e7-94e5-d751f5935ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:32.822246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea244-146b-48e7-94e5-d751f5935ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:32.829243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3ad7f-c9a9-407a-9619-84e7e7ea7154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:32.830770 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3ad7f-c9a9-407a-9619-84e7e7ea7154 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:32.840465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f0aea244-146b-48e7-94e5-d751f5935ea6 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:32.841392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1070/2155] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:32.841719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f0aea244-146b-48e7-94e5-d751f5935ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:32.855408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:32.907362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1086/2156] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:32.917719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3ad7f-c9a9-407a-9619-84e7e7ea7154 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:32.919118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-dbd3ad7f-c9a9-407a-9619-84e7e7ea7154 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:32.977917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3ad7f-c9a9-407a-9619-84e7e7ea7154 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:32.988923 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:33.026314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cb397-4503-4af7-900d-dc1d719efb99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:33.026957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cb397-4503-4af7-900d-dc1d719efb99 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:33.027243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cb397-4503-4af7-900d-dc1d719efb99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:33.027524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cb397-4503-4af7-900d-dc1d719efb99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:33.036998 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cb397-4503-4af7-900d-dc1d719efb99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:33.038417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cb397-4503-4af7-900d-dc1d719efb99 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:33.047700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1071/2157] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:33.375690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aea244-146b-48e7-94e5-d751f5935ea6 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:33.379467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f0aea244-146b-48e7-94e5-d751f5935ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:33.425793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aea244-146b-48e7-94e5-d751f5935ea6 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:33.444371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:33.445601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:33.445601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:33.445878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] PATH_INFO: `/v3/projects/05fd7de654d6488f80e6d278deffada4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:33.448852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fd7de654d6488f80e6d278deffada4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:33.450869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:33.533379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fd7de654d6488f80e6d278deffada4', 'request_id': 'req-6931cc24-0eb6-46e0-b022-9aff6d499252'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:33.543091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fd7de654d6488f80e6d278deffada4', 'request_id': 'req-6931cc24-0eb6-46e0-b022-9aff6d499252'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:33.550537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fd7de654d6488f80e6d278deffada4', 'request_id': 'req-6931cc24-0eb6-46e0-b022-9aff6d499252'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:33.563332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] The token cache is being invalidate because project 05fd7de654d6488f80e6d278deffada4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:33.563627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:33.564272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:33.580643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1087/2158] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:33 2022] DELETE /identity/v3/projects/05fd7de654d6488f80e6d278deffada4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:35.451549 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cb397-4503-4af7-900d-dc1d719efb99 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.453451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7d9cb397-4503-4af7-900d-dc1d719efb99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:35.516505 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cb397-4503-4af7-900d-dc1d719efb99 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.569378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54360d-e511-434c-ba9a-77de2fb3133b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.570385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54360d-e511-434c-ba9a-77de2fb3133b service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.570798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54360d-e511-434c-ba9a-77de2fb3133b service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.571245 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54360d-e511-434c-ba9a-77de2fb3133b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.573582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8e54360d-e511-434c-ba9a-77de2fb3133b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:35.645752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54360d-e511-434c-ba9a-77de2fb3133b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.647242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54360d-e511-434c-ba9a-77de2fb3133b service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.657356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1072/2159] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:36.718569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:36.720138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:36.792718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931cc24-0eb6-46e0-b022-9aff6d499252 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:36.797335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:36.798215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:36.798502 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:36.798780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] PATH_INFO: `/v3/users/187bf0377c494cfea608ab9fe045a9fe` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:36.799976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=187bf0377c494cfea608ab9fe045a9fe)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:36.803409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:36.852657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:36.854569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187bf0377c494cfea608ab9fe045a9fe'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:36.863848 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187bf0377c494cfea608ab9fe045a9fe'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:36.869453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187bf0377c494cfea608ab9fe045a9fe'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:36.870109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187bf0377c494cfea608ab9fe045a9fe'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:36.883050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187bf0377c494cfea608ab9fe045a9fe'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:36.897178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1088/2160] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:36 2022] DELETE /identity/v3/users/187bf0377c494cfea608ab9fe045a9fe => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:36.901703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80209e1e-7472-4ffe-810d-1689e3133b46 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:36.902224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80209e1e-7472-4ffe-810d-1689e3133b46 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:36.902337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80209e1e-7472-4ffe-810d-1689e3133b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:36.920650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-80209e1e-7472-4ffe-810d-1689e3133b46 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:36.924451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-80209e1e-7472-4ffe-810d-1689e3133b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:36.944391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:36.989381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1073/2161] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:36.998829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:37.000366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:37.087892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09292d9f-b09a-4778-8bff-0ddd604aed1a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:37.091767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39cf08-8319-4956-b817-38089c5b3759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:37.092524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39cf08-8319-4956-b817-38089c5b3759 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:37.092911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39cf08-8319-4956-b817-38089c5b3759 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:37.093199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39cf08-8319-4956-b817-38089c5b3759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:37.103127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39cf08-8319-4956-b817-38089c5b3759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:37.104583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39cf08-8319-4956-b817-38089c5b3759 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:37.114839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1089/2162] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:37.530988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80209e1e-7472-4ffe-810d-1689e3133b46 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:37.533705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-80209e1e-7472-4ffe-810d-1689e3133b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:37.563210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80209e1e-7472-4ffe-810d-1689e3133b46 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:37.573023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:37.574039 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:37.574682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:37.575542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] PATH_INFO: `/v3/projects/ec134f3bbdc342f0a8424c59a385d73f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:37.580970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec134f3bbdc342f0a8424c59a385d73f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:37.583621 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:37.680358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec134f3bbdc342f0a8424c59a385d73f', 'request_id': 'req-f6e414fb-0a5c-44cd-be94-e38c4ee81773'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:37.692635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec134f3bbdc342f0a8424c59a385d73f', 'request_id': 'req-f6e414fb-0a5c-44cd-be94-e38c4ee81773'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:37.699875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec134f3bbdc342f0a8424c59a385d73f', 'request_id': 'req-f6e414fb-0a5c-44cd-be94-e38c4ee81773'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:37.715006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] The token cache is being invalidate because project ec134f3bbdc342f0a8424c59a385d73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:37.715305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:37.715958 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:37.718478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1074/2163] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:37 2022] DELETE /identity/v3/projects/ec134f3bbdc342f0a8424c59a385d73f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:37.722370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39cf08-8319-4956-b817-38089c5b3759 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:37.735653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39cf08-8319-4956-b817-38089c5b3759 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:37.805643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:37.806528 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:37.806818 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:37.807100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] PATH_INFO: `/v3/users/19de1690c4754f06978d392c9e23514b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:37.808336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=19de1690c4754f06978d392c9e23514b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:37.810346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:37.859216 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19de1690c4754f06978d392c9e23514b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:37.866928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19de1690c4754f06978d392c9e23514b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:37.867682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19de1690c4754f06978d392c9e23514b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:37.868332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19de1690c4754f06978d392c9e23514b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:37.876252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:37.882725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19de1690c4754f06978d392c9e23514b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:37.897191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1090/2164] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:37 2022] DELETE /identity/v3/users/19de1690c4754f06978d392c9e23514b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:38.233713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:38.235431 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:38.249591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e414fb-0a5c-44cd-be94-e38c4ee81773 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:38.355934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:38.357625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:38.357928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:38.358236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] PATH_INFO: `/v3/projects/1e78f406a72f49f480308af2501cfe53` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:38.360155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e78f406a72f49f480308af2501cfe53)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:38.362059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:38.440339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e78f406a72f49f480308af2501cfe53', 'request_id': 'req-ae2aa09d-0955-48ad-8e50-6d370c695945'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:38.441874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:38.449036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e78f406a72f49f480308af2501cfe53', 'request_id': 'req-ae2aa09d-0955-48ad-8e50-6d370c695945'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:38.469751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e78f406a72f49f480308af2501cfe53', 'request_id': 'req-ae2aa09d-0955-48ad-8e50-6d370c695945'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:38.484512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] The token cache is being invalidate because project 1e78f406a72f49f480308af2501cfe53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:38.484830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:38.485467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:38.487231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1075/2165] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:38 2022] DELETE /identity/v3/projects/1e78f406a72f49f480308af2501cfe53 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:38.491316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:38.493107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:38.507787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771658a-8381-4923-977b-eaeab84e6bff admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:38.574397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb515a-9dc5-4c65-a6ce-0da01b153f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:38.575582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb515a-9dc5-4c65-a6ce-0da01b153f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:38.575582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb515a-9dc5-4c65-a6ce-0da01b153f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:38.575875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb515a-9dc5-4c65-a6ce-0da01b153f80 admin admin] PATH_INFO: `/v3/users/e99808a241034dbf97d9f2c5a8fe7230` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:38.577112 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb515a-9dc5-4c65-a6ce-0da01b153f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99808a241034dbf97d9f2c5a8fe7230)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:38.579085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb515a-9dc5-4c65-a6ce-0da01b153f80 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:38.642476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7dfb515a-9dc5-4c65-a6ce-0da01b153f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99808a241034dbf97d9f2c5a8fe7230'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:38.665084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7dfb515a-9dc5-4c65-a6ce-0da01b153f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99808a241034dbf97d9f2c5a8fe7230'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:38.666090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7dfb515a-9dc5-4c65-a6ce-0da01b153f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99808a241034dbf97d9f2c5a8fe7230'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:38.666773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7dfb515a-9dc5-4c65-a6ce-0da01b153f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99808a241034dbf97d9f2c5a8fe7230'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:38.681713 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7dfb515a-9dc5-4c65-a6ce-0da01b153f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99808a241034dbf97d9f2c5a8fe7230'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:38.705992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1091/2166] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:38 2022] DELETE /identity/v3/users/e99808a241034dbf97d9f2c5a8fe7230 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:39.401536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:39.403937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:39.423724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2aa09d-0955-48ad-8e50-6d370c695945 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:39.529819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:39.530992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.531284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.531605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] PATH_INFO: `/v3/projects/8fa061d8bb3344aba96a6016dc5b1cc7` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.533192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa061d8bb3344aba96a6016dc5b1cc7)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:39.535285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:39.607448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa061d8bb3344aba96a6016dc5b1cc7', 'request_id': 'req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.636416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa061d8bb3344aba96a6016dc5b1cc7', 'request_id': 'req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.657310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa061d8bb3344aba96a6016dc5b1cc7', 'request_id': 'req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.677409 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] The token cache is being invalidate because project 8fa061d8bb3344aba96a6016dc5b1cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:39.678174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.679098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7881b2ff-39d4-4439-aaf0-6bb48806ec0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.681032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1076/2167] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:39 2022] DELETE /identity/v3/projects/8fa061d8bb3344aba96a6016dc5b1cc7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:39.686173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2934da1-c26c-4357-971c-0e2f32782a1c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.686629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2934da1-c26c-4357-971c-0e2f32782a1c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.686796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2934da1-c26c-4357-971c-0e2f32782a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.711474 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c2934da1-c26c-4357-971c-0e2f32782a1c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:39.712858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c2934da1-c26c-4357-971c-0e2f32782a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:39.792843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1092/2168] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:39.800929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4770c-5ad2-4f99-957a-edf981fe7699 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.802241 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4770c-5ad2-4f99-957a-edf981fe7699 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.802768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4770c-5ad2-4f99-957a-edf981fe7699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.824322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9ac4770c-5ad2-4f99-957a-edf981fe7699 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:39.826073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9ac4770c-5ad2-4f99-957a-edf981fe7699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:39.835734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1077/2169] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:39.842476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2934da1-c26c-4357-971c-0e2f32782a1c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:39.849215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:39.853944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2934da1-c26c-4357-971c-0e2f32782a1c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:39.862657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360c91d-2d9e-49bb-8011-5985e50c3465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:39.863967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360c91d-2d9e-49bb-8011-5985e50c3465 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.864698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360c91d-2d9e-49bb-8011-5985e50c3465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.864990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360c91d-2d9e-49bb-8011-5985e50c3465 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.865819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360c91d-2d9e-49bb-8011-5985e50c3465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:39.866296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360c91d-2d9e-49bb-8011-5985e50c3465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:39.868342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360c91d-2d9e-49bb-8011-5985e50c3465 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:39.887540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1093/2170] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:39.888670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4770c-5ad2-4f99-957a-edf981fe7699 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:39.906376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4770c-5ad2-4f99-957a-edf981fe7699 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:39.912922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda0311-4a86-4e81-b9fe-8e12dfa40618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:39.912922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0311-4a86-4e81-b9fe-8e12dfa40618 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.913209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0311-4a86-4e81-b9fe-8e12dfa40618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.913430 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0311-4a86-4e81-b9fe-8e12dfa40618 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.914453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda0311-4a86-4e81-b9fe-8e12dfa40618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:39.916288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda0311-4a86-4e81-b9fe-8e12dfa40618 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:39.949321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1078/2171] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:39 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:39.953701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360c91d-2d9e-49bb-8011-5985e50c3465 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:39.968023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360c91d-2d9e-49bb-8011-5985e50c3465 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.052494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922faf5-5ade-4769-9681-bb8af3869e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.053140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922faf5-5ade-4769-9681-bb8af3869e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.054238 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922faf5-5ade-4769-9681-bb8af3869e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.054744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922faf5-5ade-4769-9681-bb8af3869e53 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.055954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922faf5-5ade-4769-9681-bb8af3869e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.058230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922faf5-5ade-4769-9681-bb8af3869e53 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.087797 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1094/2172] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:39 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:40.089265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda0311-4a86-4e81-b9fe-8e12dfa40618 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.107260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda0311-4a86-4e81-b9fe-8e12dfa40618 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.121672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2b398-f5b4-46e9-b413-a9b68fbd18da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.122604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2b398-f5b4-46e9-b413-a9b68fbd18da admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.123695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2b398-f5b4-46e9-b413-a9b68fbd18da admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.124701 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2b398-f5b4-46e9-b413-a9b68fbd18da admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.127086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2b398-f5b4-46e9-b413-a9b68fbd18da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.130545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2b398-f5b4-46e9-b413-a9b68fbd18da admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.176897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1079/2173] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:40.177685 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922faf5-5ade-4769-9681-bb8af3869e53 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.193763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922faf5-5ade-4769-9681-bb8af3869e53 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.212771 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6900-feea-47e4-afb2-e5cfb4e7f609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.213559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6900-feea-47e4-afb2-e5cfb4e7f609 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.213908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6900-feea-47e4-afb2-e5cfb4e7f609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.214121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6900-feea-47e4-afb2-e5cfb4e7f609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.215215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa6900-feea-47e4-afb2-e5cfb4e7f609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.217778 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa6900-feea-47e4-afb2-e5cfb4e7f609 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.248747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1095/2174] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:40.249937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2b398-f5b4-46e9-b413-a9b68fbd18da admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.260319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2b398-f5b4-46e9-b413-a9b68fbd18da admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.289185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f89b14-803d-4735-8440-302fbb095687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.290262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f89b14-803d-4735-8440-302fbb095687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.290550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f89b14-803d-4735-8440-302fbb095687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.290832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f89b14-803d-4735-8440-302fbb095687 admin admin] PATH_INFO: `/v3/projects/d0ebc34632424ea59f55118f123cb99d/users/eda7e570a1b54240b8f956cccc498f06/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.312294 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6900-feea-47e4-afb2-e5cfb4e7f609 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.314177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7baa6900-feea-47e4-afb2-e5cfb4e7f609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:40.323599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f89b14-803d-4735-8440-302fbb095687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ebc34632424ea59f55118f123cb99d, user_id=eda7e570a1b54240b8f956cccc498f06, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.327068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f89b14-803d-4735-8440-302fbb095687 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.331727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6900-feea-47e4-afb2-e5cfb4e7f609 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.344139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.345164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.345523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.345889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] PATH_INFO: `/v3/users/080c9080677b4fbeb73f82439eee5789` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.347629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=080c9080677b4fbeb73f82439eee5789)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.350278 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.352434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1080/2175] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:40 2022] PUT /identity/v3/projects/d0ebc34632424ea59f55118f123cb99d/users/eda7e570a1b54240b8f956cccc498f06/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:40.365423 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cfdc-6e14-4a1e-9c59-d7730f64090e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.365790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cfdc-6e14-4a1e-9c59-d7730f64090e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.365982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cfdc-6e14-4a1e-9c59-d7730f64090e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.375853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:40.388891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ec22cfdc-6e14-4a1e-9c59-d7730f64090e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:40.391211 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ec22cfdc-6e14-4a1e-9c59-d7730f64090e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:40.412897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080c9080677b4fbeb73f82439eee5789'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.421098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080c9080677b4fbeb73f82439eee5789'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.421867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080c9080677b4fbeb73f82439eee5789'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.422510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080c9080677b4fbeb73f82439eee5789'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.438851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080c9080677b4fbeb73f82439eee5789'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.459897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1096/2176] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:40 2022] DELETE /identity/v3/users/080c9080677b4fbeb73f82439eee5789 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:40.460072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1081/2177] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:40.467885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.469332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:40.530184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:40.544753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5ba8d-7e3c-464f-a49f-45a837d12b18 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.548860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240026d8-3416-41e9-bc0b-9a1d7f443a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.549534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240026d8-3416-41e9-bc0b-9a1d7f443a90 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.549822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240026d8-3416-41e9-bc0b-9a1d7f443a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.550101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240026d8-3416-41e9-bc0b-9a1d7f443a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.615558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240026d8-3416-41e9-bc0b-9a1d7f443a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.617074 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240026d8-3416-41e9-bc0b-9a1d7f443a90 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.633660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1097/2178] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:40.653721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22cfdc-6e14-4a1e-9c59-d7730f64090e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.655350 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ec22cfdc-6e14-4a1e-9c59-d7730f64090e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:40.681306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22cfdc-6e14-4a1e-9c59-d7730f64090e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.702608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.703656 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.704161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.704676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] PATH_INFO: `/v3/projects/32eeeff90a6c4ae7a6455e436a32415b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.706214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32eeeff90a6c4ae7a6455e436a32415b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.708489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.773116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32eeeff90a6c4ae7a6455e436a32415b', 'request_id': 'req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.782455 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32eeeff90a6c4ae7a6455e436a32415b', 'request_id': 'req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.794717 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32eeeff90a6c4ae7a6455e436a32415b', 'request_id': 'req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.810548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] The token cache is being invalidate because project 32eeeff90a6c4ae7a6455e436a32415b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:40.810972 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.811728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f58f5d5d-bd20-4ce4-870a-c05fb7a1b031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.816760 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1082/2179] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:40 2022] DELETE /identity/v3/projects/32eeeff90a6c4ae7a6455e436a32415b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:40.819047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b06e8e-d946-406a-bdbc-6b0c1206b55c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.819679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b06e8e-d946-406a-bdbc-6b0c1206b55c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.819679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b06e8e-d946-406a-bdbc-6b0c1206b55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.844820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e1b06e8e-d946-406a-bdbc-6b0c1206b55c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:40.845937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e1b06e8e-d946-406a-bdbc-6b0c1206b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:40.936722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1098/2180] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:40.945358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcffbe-36e6-47ae-a6f9-acbb90ee4a3d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.946035 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcffbe-36e6-47ae-a6f9-acbb90ee4a3d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.946320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcffbe-36e6-47ae-a6f9-acbb90ee4a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.000680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-48fcffbe-36e6-47ae-a6f9-acbb90ee4a3d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:41.002019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-48fcffbe-36e6-47ae-a6f9-acbb90ee4a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:41.017342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1083/2181] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:41.018110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b06e8e-d946-406a-bdbc-6b0c1206b55c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.032835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b06e8e-d946-406a-bdbc-6b0c1206b55c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.048003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27143c23-d45c-464b-9fd8-9742cf966c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.048924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27143c23-d45c-464b-9fd8-9742cf966c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.049127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27143c23-d45c-464b-9fd8-9742cf966c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.049515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27143c23-d45c-464b-9fd8-9742cf966c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.051178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27143c23-d45c-464b-9fd8-9742cf966c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:41.051639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27143c23-d45c-464b-9fd8-9742cf966c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.053693 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27143c23-d45c-464b-9fd8-9742cf966c35 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.072099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1099/2182] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:14:41.073725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcffbe-36e6-47ae-a6f9-acbb90ee4a3d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.087027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcffbe-36e6-47ae-a6f9-acbb90ee4a3d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.095248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed11c9-4133-40c5-8498-94deeb58ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.095937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed11c9-4133-40c5-8498-94deeb58ed32 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.096238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed11c9-4133-40c5-8498-94deeb58ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.096537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed11c9-4133-40c5-8498-94deeb58ed32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.097263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed11c9-4133-40c5-8498-94deeb58ed32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.100140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed11c9-4133-40c5-8498-94deeb58ed32 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.132117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1084/2183] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:41 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:41.136144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27143c23-d45c-464b-9fd8-9742cf966c35 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.149149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27143c23-d45c-464b-9fd8-9742cf966c35 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.211755 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24251775-d109-49c1-b935-184f9463438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.212440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251775-d109-49c1-b935-184f9463438d admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.212765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251775-d109-49c1-b935-184f9463438d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.213053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251775-d109-49c1-b935-184f9463438d admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.213753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24251775-d109-49c1-b935-184f9463438d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.215718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24251775-d109-49c1-b935-184f9463438d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.236056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1100/2184] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:41 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:41.241678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed11c9-4133-40c5-8498-94deeb58ed32 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.252305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed11c9-4133-40c5-8498-94deeb58ed32 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.257868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f009f27-9dba-481f-8819-d90e892bc4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.258544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f009f27-9dba-481f-8819-d90e892bc4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.258841 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f009f27-9dba-481f-8819-d90e892bc4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.259150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f009f27-9dba-481f-8819-d90e892bc4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.260066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f009f27-9dba-481f-8819-d90e892bc4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.262077 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f009f27-9dba-481f-8819-d90e892bc4f2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.273703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1085/2185] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:41.277739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24251775-d109-49c1-b935-184f9463438d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.289275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24251775-d109-49c1-b935-184f9463438d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.294034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7f1c7-38f7-43cf-a249-3abddf2bdc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.294697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f1c7-38f7-43cf-a249-3abddf2bdc94 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.294983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f1c7-38f7-43cf-a249-3abddf2bdc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.295262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f1c7-38f7-43cf-a249-3abddf2bdc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.296000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7f1c7-38f7-43cf-a249-3abddf2bdc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.297644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7f1c7-38f7-43cf-a249-3abddf2bdc94 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.300136 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:41.310703 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1101/2186] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:41.315715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f009f27-9dba-481f-8819-d90e892bc4f2 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.334395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f009f27-9dba-481f-8819-d90e892bc4f2 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.344281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38756d0f-7998-4467-82eb-2454203e2e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.345255 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38756d0f-7998-4467-82eb-2454203e2e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.345520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38756d0f-7998-4467-82eb-2454203e2e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.345960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38756d0f-7998-4467-82eb-2454203e2e56 admin admin] PATH_INFO: `/v3/projects/4431e6936a5d40e8b0a8fe80fd2d8dea/users/c2df26598b1740c5a787df0e552adf31/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.366857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38756d0f-7998-4467-82eb-2454203e2e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4431e6936a5d40e8b0a8fe80fd2d8dea, user_id=c2df26598b1740c5a787df0e552adf31, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.370208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38756d0f-7998-4467-82eb-2454203e2e56 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.397392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1086/2187] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:41 2022] PUT /identity/v3/projects/4431e6936a5d40e8b0a8fe80fd2d8dea/users/c2df26598b1740c5a787df0e552adf31/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:41.413737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4a9a4-9a44-4998-878a-b1689dab8b1d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.414335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4a9a4-9a44-4998-878a-b1689dab8b1d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.414674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4a9a4-9a44-4998-878a-b1689dab8b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.417508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3118e6-808e-4718-8dd6-1a4c705ce9ed None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.417807 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3118e6-808e-4718-8dd6-1a4c705ce9ed None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.418102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3118e6-808e-4718-8dd6-1a4c705ce9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.451056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d3e4a9a4-9a44-4998-878a-b1689dab8b1d None None] MFA Rules not processed for user `c2df26598b1740c5a787df0e552adf31`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:41.451194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8e3118e6-808e-4718-8dd6-1a4c705ce9ed None None] MFA Rules not processed for user `eda7e570a1b54240b8f956cccc498f06`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:41.452419 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8e3118e6-808e-4718-8dd6-1a4c705ce9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:41.452557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d3e4a9a4-9a44-4998-878a-b1689dab8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:41.467003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:41.550024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1102/2188] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:41.557433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1087/2189] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:41.565219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4a9a4-9a44-4998-878a-b1689dab8b1d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.565680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3118e6-808e-4718-8dd6-1a4c705ce9ed None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.566760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d3e4a9a4-9a44-4998-878a-b1689dab8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:41.567606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8e3118e6-808e-4718-8dd6-1a4c705ce9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:41.638423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4a9a4-9a44-4998-878a-b1689dab8b1d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.642173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4034c-9008-46da-afde-b7653eb54754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.642832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4034c-9008-46da-afde-b7653eb54754 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.643122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4034c-9008-46da-afde-b7653eb54754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.643380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3118e6-808e-4718-8dd6-1a4c705ce9ed None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.643483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4034c-9008-46da-afde-b7653eb54754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.648091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5072e1-17c0-427a-8222-5d590fe3b4c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.648782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5072e1-17c0-427a-8222-5d590fe3b4c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.649190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5072e1-17c0-427a-8222-5d590fe3b4c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.649365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5072e1-17c0-427a-8222-5d590fe3b4c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.654367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4034c-9008-46da-afde-b7653eb54754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.658333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4034c-9008-46da-afde-b7653eb54754 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.658761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5072e1-17c0-427a-8222-5d590fe3b4c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.660209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5072e1-17c0-427a-8222-5d590fe3b4c5 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.668345 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1103/2190] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:41.670605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1088/2191] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:43.039199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a91fc9-a54b-452c-9e96-456c6f937f62 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:43.039697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a91fc9-a54b-452c-9e96-456c6f937f62 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:43.039791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a91fc9-a54b-452c-9e96-456c6f937f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:43.059737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-21a91fc9-a54b-452c-9e96-456c6f937f62 None None] MFA Rules not processed for user `eda7e570a1b54240b8f956cccc498f06`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:43.060979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-21a91fc9-a54b-452c-9e96-456c6f937f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:43.068953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1104/2192] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:51.258559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5072e1-17c0-427a-8222-5d590fe3b4c5 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:51.327985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5072e1-17c0-427a-8222-5d590fe3b4c5 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:51.332444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:51.334450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:51.334739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:51.335016 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] PATH_INFO: `/v3/users/c2df26598b1740c5a787df0e552adf31` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:51.336436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2df26598b1740c5a787df0e552adf31)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:51.338553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:51.388911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2df26598b1740c5a787df0e552adf31'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:51.397155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2df26598b1740c5a787df0e552adf31'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:51.397777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2df26598b1740c5a787df0e552adf31'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:51.398393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2df26598b1740c5a787df0e552adf31'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:51.403099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:51.412976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2df26598b1740c5a787df0e552adf31'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:51.425810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1089/2193] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:51 2022] DELETE /identity/v3/users/c2df26598b1740c5a787df0e552adf31 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:51.431146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c88bfd-8d93-4c2c-88ab-08e0dc97232c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:51.431661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c88bfd-8d93-4c2c-88ab-08e0dc97232c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:51.431791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c88bfd-8d93-4c2c-88ab-08e0dc97232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:51.450446 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e1c88bfd-8d93-4c2c-88ab-08e0dc97232c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:51.451636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e1c88bfd-8d93-4c2c-88ab-08e0dc97232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:51.513728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1105/2194] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:51.524827 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:51.526305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:51.609750 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4b7f7-b043-4c70-aaa7-376e98dbce42 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:51.613676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a920edb-d357-4cda-ab5c-94e74bd86046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:51.614896 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a920edb-d357-4cda-ab5c-94e74bd86046 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:51.615181 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a920edb-d357-4cda-ab5c-94e74bd86046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:51.615467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a920edb-d357-4cda-ab5c-94e74bd86046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:51.626285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a920edb-d357-4cda-ab5c-94e74bd86046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:51.627728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a920edb-d357-4cda-ab5c-94e74bd86046 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:51.639087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1090/2195] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:51.908942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c88bfd-8d93-4c2c-88ab-08e0dc97232c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:51.910473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e1c88bfd-8d93-4c2c-88ab-08e0dc97232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:51.929035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c88bfd-8d93-4c2c-88ab-08e0dc97232c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:51.934015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:51.934950 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:51.935258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:51.935544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] PATH_INFO: `/v3/projects/4431e6936a5d40e8b0a8fe80fd2d8dea` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:51.936838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4431e6936a5d40e8b0a8fe80fd2d8dea)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:51.938767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:51.960495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:51.986718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4431e6936a5d40e8b0a8fe80fd2d8dea', 'request_id': 'req-1027bf40-2b4b-44b2-87a5-cca01674e775'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:51.994726 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4431e6936a5d40e8b0a8fe80fd2d8dea', 'request_id': 'req-1027bf40-2b4b-44b2-87a5-cca01674e775'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:52.004700 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4431e6936a5d40e8b0a8fe80fd2d8dea', 'request_id': 'req-1027bf40-2b4b-44b2-87a5-cca01674e775'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:52.016511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] The token cache is being invalidate because project 4431e6936a5d40e8b0a8fe80fd2d8dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:52.016930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:52.017637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1027bf40-2b4b-44b2-87a5-cca01674e775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:52.019224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1106/2196] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:51 2022] DELETE /identity/v3/projects/4431e6936a5d40e8b0a8fe80fd2d8dea => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:52.024750 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ed4c-c462-4a7e-87bd-e3d893d80ad4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:52.025052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ed4c-c462-4a7e-87bd-e3d893d80ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:52.025340 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ed4c-c462-4a7e-87bd-e3d893d80ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:52.045819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c780ed4c-c462-4a7e-87bd-e3d893d80ad4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:52.047042 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c780ed4c-c462-4a7e-87bd-e3d893d80ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:52.135703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1091/2197] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:52.143334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325f1b-e79f-44c6-8a53-8b4c21c754fa None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:52.143626 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325f1b-e79f-44c6-8a53-8b4c21c754fa None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:52.143909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325f1b-e79f-44c6-8a53-8b4c21c754fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:52.170403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-76325f1b-e79f-44c6-8a53-8b4c21c754fa None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:52.172303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-76325f1b-e79f-44c6-8a53-8b4c21c754fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:52.184568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1107/2198] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:52.189293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780ed4c-c462-4a7e-87bd-e3d893d80ad4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:52.200260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780ed4c-c462-4a7e-87bd-e3d893d80ad4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:52.205180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de5f7b-994c-4d5b-bae9-1545562b67db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:52.205946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de5f7b-994c-4d5b-bae9-1545562b67db admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:52.206321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de5f7b-994c-4d5b-bae9-1545562b67db admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:52.206657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de5f7b-994c-4d5b-bae9-1545562b67db admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:52.207495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de5f7b-994c-4d5b-bae9-1545562b67db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:52.208666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de5f7b-994c-4d5b-bae9-1545562b67db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:52.210499 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de5f7b-994c-4d5b-bae9-1545562b67db admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:52.224380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1092/2199] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:52.229411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76325f1b-e79f-44c6-8a53-8b4c21c754fa None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:52.239209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76325f1b-e79f-44c6-8a53-8b4c21c754fa None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:52.244141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf696a6-5f54-431d-9050-7b38df61d790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:52.244846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf696a6-5f54-431d-9050-7b38df61d790 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:52.245132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf696a6-5f54-431d-9050-7b38df61d790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:52.245431 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf696a6-5f54-431d-9050-7b38df61d790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:52.246137 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf696a6-5f54-431d-9050-7b38df61d790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:52.248063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf696a6-5f54-431d-9050-7b38df61d790 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:52.275984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1108/2200] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:52 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:52.280091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de5f7b-994c-4d5b-bae9-1545562b67db admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:52.290961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de5f7b-994c-4d5b-bae9-1545562b67db admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:52.378751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa7c65-dfcd-49d5-af0f-2c431676edf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:52.380708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa7c65-dfcd-49d5-af0f-2c431676edf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:52.381173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa7c65-dfcd-49d5-af0f-2c431676edf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:52.381594 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa7c65-dfcd-49d5-af0f-2c431676edf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:52.383700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa7c65-dfcd-49d5-af0f-2c431676edf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:52.385999 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa7c65-dfcd-49d5-af0f-2c431676edf7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:52.398602 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:52.412706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1093/2201] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:52 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:52.415527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf696a6-5f54-431d-9050-7b38df61d790 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:52.440273 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf696a6-5f54-431d-9050-7b38df61d790 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:52.448793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db06d87-b33e-4f3b-b5b4-d37539f0fe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:52.449482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db06d87-b33e-4f3b-b5b4-d37539f0fe4e admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:52.449765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db06d87-b33e-4f3b-b5b4-d37539f0fe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:52.450041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db06d87-b33e-4f3b-b5b4-d37539f0fe4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:52.450803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db06d87-b33e-4f3b-b5b4-d37539f0fe4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:52.452557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db06d87-b33e-4f3b-b5b4-d37539f0fe4e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:52.465241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1109/2202] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:52.470961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa7c65-dfcd-49d5-af0f-2c431676edf7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:52.483547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa7c65-dfcd-49d5-af0f-2c431676edf7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:52.490825 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad6be6-08b4-48da-98ff-d3717a7fbbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:52.491510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad6be6-08b4-48da-98ff-d3717a7fbbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:52.491795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad6be6-08b4-48da-98ff-d3717a7fbbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:52.492072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad6be6-08b4-48da-98ff-d3717a7fbbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:52.493053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad6be6-08b4-48da-98ff-d3717a7fbbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:52.496061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad6be6-08b4-48da-98ff-d3717a7fbbb0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:52.506248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1094/2203] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:52.510292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db06d87-b33e-4f3b-b5b4-d37539f0fe4e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:52.521275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db06d87-b33e-4f3b-b5b4-d37539f0fe4e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:52.526359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fc0c1-c204-4588-ad89-0753744aa6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:52.527364 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fc0c1-c204-4588-ad89-0753744aa6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:52.527715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fc0c1-c204-4588-ad89-0753744aa6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:52.528061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fc0c1-c204-4588-ad89-0753744aa6a9 admin admin] PATH_INFO: `/v3/projects/09a80a84538048ea8bd4c51a4813ddd4/users/70dfed12f870440498dcda0cfb2b9238/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:52.545969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fc0c1-c204-4588-ad89-0753744aa6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a80a84538048ea8bd4c51a4813ddd4, user_id=70dfed12f870440498dcda0cfb2b9238, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:52.548798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fc0c1-c204-4588-ad89-0753744aa6a9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:52.563887 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1110/2204] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:52 2022] PUT /identity/v3/projects/09a80a84538048ea8bd4c51a4813ddd4/users/70dfed12f870440498dcda0cfb2b9238/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:52.574059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77817227-603f-4350-aabc-197148640cad None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:52.574351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77817227-603f-4350-aabc-197148640cad None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:52.574636 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77817227-603f-4350-aabc-197148640cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:52.603014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-77817227-603f-4350-aabc-197148640cad None None] MFA Rules not processed for user `70dfed12f870440498dcda0cfb2b9238`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:52.604248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-77817227-603f-4350-aabc-197148640cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:52.683376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1095/2205] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:52.695707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fc0c1-c204-4588-ad89-0753744aa6a9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:52.697579 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-202fc0c1-c204-4588-ad89-0753744aa6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:52.787181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fc0c1-c204-4588-ad89-0753744aa6a9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:52.793225 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d25aec-3d74-4044-8637-c5e39fed65d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:52.793875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d25aec-3d74-4044-8637-c5e39fed65d3 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:52.794159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d25aec-3d74-4044-8637-c5e39fed65d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:52.794438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d25aec-3d74-4044-8637-c5e39fed65d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:52.803127 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d25aec-3d74-4044-8637-c5e39fed65d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:52.804745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d25aec-3d74-4044-8637-c5e39fed65d3 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:52.814776 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1111/2206] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:53.057581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77817227-603f-4350-aabc-197148640cad None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:53.123687 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77817227-603f-4350-aabc-197148640cad None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:53.128387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:53.129287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.129688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.130098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] PATH_INFO: `/v3/users/70dfed12f870440498dcda0cfb2b9238` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.131406 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70dfed12f870440498dcda0cfb2b9238)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:53.133535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:53.183913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70dfed12f870440498dcda0cfb2b9238'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.193811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70dfed12f870440498dcda0cfb2b9238'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.195556 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70dfed12f870440498dcda0cfb2b9238'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.196434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70dfed12f870440498dcda0cfb2b9238'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.214922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70dfed12f870440498dcda0cfb2b9238'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.220641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:53.233436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1096/2207] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:53 2022] DELETE /identity/v3/users/70dfed12f870440498dcda0cfb2b9238 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:53.237784 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1050-c417-410a-bd3e-4b4cf613c308 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.238078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1050-c417-410a-bd3e-4b4cf613c308 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.238359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1050-c417-410a-bd3e-4b4cf613c308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.256754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-47ed1050-c417-410a-bd3e-4b4cf613c308 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:53.257971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-47ed1050-c417-410a-bd3e-4b4cf613c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:53.286010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:53.325688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1112/2208] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:53.336204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:53.337706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:53.397508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9bb5-7fb5-43ba-b58c-638deee01d28 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:53.401303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac77f22-677a-4c96-87ba-e4009bcc11ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:53.402010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac77f22-677a-4c96-87ba-e4009bcc11ad service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.402354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac77f22-677a-4c96-87ba-e4009bcc11ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.402635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac77f22-677a-4c96-87ba-e4009bcc11ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.412557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac77f22-677a-4c96-87ba-e4009bcc11ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:53.414024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac77f22-677a-4c96-87ba-e4009bcc11ad service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:53.424725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1097/2209] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:53.749524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1050-c417-410a-bd3e-4b4cf613c308 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:53.751063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-47ed1050-c417-410a-bd3e-4b4cf613c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:53.764888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1050-c417-410a-bd3e-4b4cf613c308 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:53.769600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:53.770853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.771165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.771448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] PATH_INFO: `/v3/projects/09a80a84538048ea8bd4c51a4813ddd4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.772750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a80a84538048ea8bd4c51a4813ddd4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:53.774826 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:53.821997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a80a84538048ea8bd4c51a4813ddd4', 'request_id': 'req-9c48fb8a-8ac7-496e-8afe-76182a127418'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.828054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a80a84538048ea8bd4c51a4813ddd4', 'request_id': 'req-9c48fb8a-8ac7-496e-8afe-76182a127418'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.836022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a80a84538048ea8bd4c51a4813ddd4', 'request_id': 'req-9c48fb8a-8ac7-496e-8afe-76182a127418'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.846446 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] The token cache is being invalidate because project 09a80a84538048ea8bd4c51a4813ddd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:53.846736 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.847388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9c48fb8a-8ac7-496e-8afe-76182a127418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.849680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1113/2210] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:53 2022] DELETE /identity/v3/projects/09a80a84538048ea8bd4c51a4813ddd4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:53.854647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290fd42-4209-4528-9edc-a20ce5b517bb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.854942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290fd42-4209-4528-9edc-a20ce5b517bb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.855230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290fd42-4209-4528-9edc-a20ce5b517bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.873043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1290fd42-4209-4528-9edc-a20ce5b517bb None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:53.874284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1290fd42-4209-4528-9edc-a20ce5b517bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:53.933022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1098/2211] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:53.941848 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa77f-fd78-4032-b516-6d6a45066798 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.942222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa77f-fd78-4032-b516-6d6a45066798 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.942504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa77f-fd78-4032-b516-6d6a45066798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.960944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6f4fa77f-fd78-4032-b516-6d6a45066798 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:53.962183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6f4fa77f-fd78-4032-b516-6d6a45066798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:53.970158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1114/2212] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:53.975139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290fd42-4209-4528-9edc-a20ce5b517bb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:53.985455 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290fd42-4209-4528-9edc-a20ce5b517bb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:53.990516 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534e1a3-1210-4b07-ba45-59a8b62827d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:53.991173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e1a3-1210-4b07-ba45-59a8b62827d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.991461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e1a3-1210-4b07-ba45-59a8b62827d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.991743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e1a3-1210-4b07-ba45-59a8b62827d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.992477 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534e1a3-1210-4b07-ba45-59a8b62827d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:53.992824 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534e1a3-1210-4b07-ba45-59a8b62827d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:53.994438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534e1a3-1210-4b07-ba45-59a8b62827d6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.007316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1099/2213] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:54.011489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fa77f-fd78-4032-b516-6d6a45066798 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.021453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fa77f-fd78-4032-b516-6d6a45066798 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.026338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d1276-24c0-4c87-bc3c-303ada6994e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.027009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d1276-24c0-4c87-bc3c-303ada6994e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.027300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d1276-24c0-4c87-bc3c-303ada6994e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.027604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d1276-24c0-4c87-bc3c-303ada6994e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.028327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d1276-24c0-4c87-bc3c-303ada6994e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.030354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d1276-24c0-4c87-bc3c-303ada6994e9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.057343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1115/2214] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:54 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:54.061517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534e1a3-1210-4b07-ba45-59a8b62827d6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.072196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534e1a3-1210-4b07-ba45-59a8b62827d6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.126813 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afbbb8-dbef-4a37-8199-b1494aecde2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.127474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afbbb8-dbef-4a37-8199-b1494aecde2e admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.127758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afbbb8-dbef-4a37-8199-b1494aecde2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.128034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afbbb8-dbef-4a37-8199-b1494aecde2e admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.128768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afbbb8-dbef-4a37-8199-b1494aecde2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.131307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afbbb8-dbef-4a37-8199-b1494aecde2e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.153951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1100/2215] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:54 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:54.155109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d1276-24c0-4c87-bc3c-303ada6994e9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.166176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d1276-24c0-4c87-bc3c-303ada6994e9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.170859 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbb656-6fcb-4bf7-b74c-697b04d6aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.171518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbb656-6fcb-4bf7-b74c-697b04d6aa26 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.171805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbb656-6fcb-4bf7-b74c-697b04d6aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.172084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbb656-6fcb-4bf7-b74c-697b04d6aa26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.172858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbb656-6fcb-4bf7-b74c-697b04d6aa26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.174522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbb656-6fcb-4bf7-b74c-697b04d6aa26 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.185231 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1116/2216] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:54.189102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afbbb8-dbef-4a37-8199-b1494aecde2e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.200007 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afbbb8-dbef-4a37-8199-b1494aecde2e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.205926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b12a8-7ff7-4acb-8573-0fd96eb7860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.206710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b12a8-7ff7-4acb-8573-0fd96eb7860d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.207098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b12a8-7ff7-4acb-8573-0fd96eb7860d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.207382 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b12a8-7ff7-4acb-8573-0fd96eb7860d admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.208813 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b12a8-7ff7-4acb-8573-0fd96eb7860d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.210744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b12a8-7ff7-4acb-8573-0fd96eb7860d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.221723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1101/2217] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:54.226016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbb656-6fcb-4bf7-b74c-697b04d6aa26 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.235894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbb656-6fcb-4bf7-b74c-697b04d6aa26 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.240633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8849a6a-f067-4636-b6a4-469f0ef2a84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.241745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8849a6a-f067-4636-b6a4-469f0ef2a84e admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.242035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8849a6a-f067-4636-b6a4-469f0ef2a84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.242311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8849a6a-f067-4636-b6a4-469f0ef2a84e admin admin] PATH_INFO: `/v3/projects/fe4c3f3e847d447dacbf448dfd567f88/users/46add921924445e38e54c9a1f71b88ae/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.258677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8849a6a-f067-4636-b6a4-469f0ef2a84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4c3f3e847d447dacbf448dfd567f88, user_id=46add921924445e38e54c9a1f71b88ae, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.263490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8849a6a-f067-4636-b6a4-469f0ef2a84e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.275160 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1117/2218] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:54 2022] PUT /identity/v3/projects/fe4c3f3e847d447dacbf448dfd567f88/users/46add921924445e38e54c9a1f71b88ae/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:54.285333 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd19fdc-d772-416c-b2cd-b0d8cfeb714c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.285965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd19fdc-d772-416c-b2cd-b0d8cfeb714c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.286311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd19fdc-d772-416c-b2cd-b0d8cfeb714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.293430 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:54.319077 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9fd19fdc-d772-416c-b2cd-b0d8cfeb714c None None] MFA Rules not processed for user `46add921924445e38e54c9a1f71b88ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:54.320166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9fd19fdc-d772-416c-b2cd-b0d8cfeb714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:54.391654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1102/2219] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:54.396444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8849a6a-f067-4636-b6a4-469f0ef2a84e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.465681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:54.483962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8849a6a-f067-4636-b6a4-469f0ef2a84e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.490131 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa33d0d-5f57-42e2-b5aa-f5d7c5816392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.490829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33d0d-5f57-42e2-b5aa-f5d7c5816392 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.491118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33d0d-5f57-42e2-b5aa-f5d7c5816392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.491397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33d0d-5f57-42e2-b5aa-f5d7c5816392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.492095 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa33d0d-5f57-42e2-b5aa-f5d7c5816392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.494069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa33d0d-5f57-42e2-b5aa-f5d7c5816392 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.524449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1118/2220] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:54 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:54.525919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd19fdc-d772-416c-b2cd-b0d8cfeb714c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.537589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd19fdc-d772-416c-b2cd-b0d8cfeb714c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.595881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760089a-5200-4914-a2b9-582a99c8064d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.596553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760089a-5200-4914-a2b9-582a99c8064d admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.596890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760089a-5200-4914-a2b9-582a99c8064d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.597149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760089a-5200-4914-a2b9-582a99c8064d admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.597926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760089a-5200-4914-a2b9-582a99c8064d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.600522 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760089a-5200-4914-a2b9-582a99c8064d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.620482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1103/2221] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:54 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:54.624536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa33d0d-5f57-42e2-b5aa-f5d7c5816392 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.635777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa33d0d-5f57-42e2-b5aa-f5d7c5816392 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.640890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad8453-1c9b-4e57-8de8-80d2f197b501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.641575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad8453-1c9b-4e57-8de8-80d2f197b501 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.641865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad8453-1c9b-4e57-8de8-80d2f197b501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.642141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad8453-1c9b-4e57-8de8-80d2f197b501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.642874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad8453-1c9b-4e57-8de8-80d2f197b501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.644554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad8453-1c9b-4e57-8de8-80d2f197b501 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.655685 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1119/2222] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:54.659924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760089a-5200-4914-a2b9-582a99c8064d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.670277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760089a-5200-4914-a2b9-582a99c8064d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.675146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a03f2-fd41-46b1-91ca-8e32390add8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.676022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a03f2-fd41-46b1-91ca-8e32390add8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.676963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a03f2-fd41-46b1-91ca-8e32390add8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.677395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a03f2-fd41-46b1-91ca-8e32390add8a admin admin] PATH_INFO: `/v3/projects/db8cd970c45c4ff6a58807af94b10847/users/5da5597b770143c6ac63d6566b84dcc7/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.693676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a03f2-fd41-46b1-91ca-8e32390add8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8cd970c45c4ff6a58807af94b10847, user_id=5da5597b770143c6ac63d6566b84dcc7, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.696955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a03f2-fd41-46b1-91ca-8e32390add8a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.710294 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1104/2223] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:54 2022] PUT /identity/v3/projects/db8cd970c45c4ff6a58807af94b10847/users/5da5597b770143c6ac63d6566b84dcc7/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:54.714563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad8453-1c9b-4e57-8de8-80d2f197b501 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.725409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad8453-1c9b-4e57-8de8-80d2f197b501 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.783195 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f716981-8385-45d1-85c1-1441e34938f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.783896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f716981-8385-45d1-85c1-1441e34938f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.784142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f716981-8385-45d1-85c1-1441e34938f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.784421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f716981-8385-45d1-85c1-1441e34938f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.785199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f716981-8385-45d1-85c1-1441e34938f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.787569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f716981-8385-45d1-85c1-1441e34938f4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.797738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1120/2224] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:54.802552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a03f2-fd41-46b1-91ca-8e32390add8a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.813240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a03f2-fd41-46b1-91ca-8e32390add8a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.818686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327984f-c2bc-48a5-b053-ea5495c19714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.819600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327984f-c2bc-48a5-b053-ea5495c19714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.819885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327984f-c2bc-48a5-b053-ea5495c19714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.820164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327984f-c2bc-48a5-b053-ea5495c19714 admin admin] PATH_INFO: `/v3/projects/db8cd970c45c4ff6a58807af94b10847/users/5da5597b770143c6ac63d6566b84dcc7/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.822647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327984f-c2bc-48a5-b053-ea5495c19714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8cd970c45c4ff6a58807af94b10847, user_id=5da5597b770143c6ac63d6566b84dcc7, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.824907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327984f-c2bc-48a5-b053-ea5495c19714 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.837690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1105/2225] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:54 2022] PUT /identity/v3/projects/db8cd970c45c4ff6a58807af94b10847/users/5da5597b770143c6ac63d6566b84dcc7/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:54.847750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b2c3-98c8-4492-a5b4-293760b7e0c5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.848047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b2c3-98c8-4492-a5b4-293760b7e0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.848948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b2c3-98c8-4492-a5b4-293760b7e0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.880827 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bd04b2c3-98c8-4492-a5b4-293760b7e0c5 None None] MFA Rules not processed for user `5da5597b770143c6ac63d6566b84dcc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:54.882153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bd04b2c3-98c8-4492-a5b4-293760b7e0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:54.952189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1121/2226] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:54.963613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327984f-c2bc-48a5-b053-ea5495c19714 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.965507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6327984f-c2bc-48a5-b053-ea5495c19714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:55.011956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:55.023355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327984f-c2bc-48a5-b053-ea5495c19714 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:55.026991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d24087-de58-42c4-bd08-f9ec56f88172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:55.027626 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d24087-de58-42c4-bd08-f9ec56f88172 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:55.027915 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d24087-de58-42c4-bd08-f9ec56f88172 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:55.028182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d24087-de58-42c4-bd08-f9ec56f88172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:55.040442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d24087-de58-42c4-bd08-f9ec56f88172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:55.041897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d24087-de58-42c4-bd08-f9ec56f88172 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:55.051925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1106/2227] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:55.122500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04b2c3-98c8-4492-a5b4-293760b7e0c5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:55.132359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04b2c3-98c8-4492-a5b4-293760b7e0c5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:55.136014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050acb03-4dfa-4f82-89cd-c25fd11b3aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:55.136690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050acb03-4dfa-4f82-89cd-c25fd11b3aec service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:55.136980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050acb03-4dfa-4f82-89cd-c25fd11b3aec service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:55.137263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050acb03-4dfa-4f82-89cd-c25fd11b3aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:55.179833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:55.195859 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050acb03-4dfa-4f82-89cd-c25fd11b3aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:55.197374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050acb03-4dfa-4f82-89cd-c25fd11b3aec service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:55.206163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1122/2228] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:56.713502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a085-6817-4bd1-9174-29434f684b8b None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:56.714011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a085-6817-4bd1-9174-29434f684b8b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:56.714107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a085-6817-4bd1-9174-29434f684b8b None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:56.715490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1107/2229] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:14:56.723153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9ade0-b4a1-46eb-9ec9-e430cbe2142c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:56.724154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9ade0-b4a1-46eb-9ec9-e430cbe2142c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:56.724797 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9ade0-b4a1-46eb-9ec9-e430cbe2142c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:56.751603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a5e9ade0-b4a1-46eb-9ec9-e430cbe2142c None None] MFA Rules not processed for user `577f89ef22954926bdf02a15484f8f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:56.752946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a5e9ade0-b4a1-46eb-9ec9-e430cbe2142c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:56.786345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3a085-6817-4bd1-9174-29434f684b8b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:56.792786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2bc3a085-6817-4bd1-9174-29434f684b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:56.837133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1123/2230] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:14:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:56.849611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9ade0-b4a1-46eb-9ec9-e430cbe2142c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:56.851379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a5e9ade0-b4a1-46eb-9ec9-e430cbe2142c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:56.865103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9ade0-b4a1-46eb-9ec9-e430cbe2142c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:56.870774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba5ce2-ed32-4fb4-ae3f-3c599d46702e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:56.871427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba5ce2-ed32-4fb4-ae3f-3c599d46702e service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:56.871770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba5ce2-ed32-4fb4-ae3f-3c599d46702e service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:56.872181 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba5ce2-ed32-4fb4-ae3f-3c599d46702e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:56.879244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3a085-6817-4bd1-9174-29434f684b8b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:56.885817 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba5ce2-ed32-4fb4-ae3f-3c599d46702e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:56.886536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:56.887454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:56.887834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:56.888102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] PATH_INFO: `/v3/users/8f625c0a37324e2d996676563cb128b9` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:56.888205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba5ce2-ed32-4fb4-ae3f-3c599d46702e service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:56.889612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f625c0a37324e2d996676563cb128b9)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:56.892231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:56.899520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1124/2231] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:56.942960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f625c0a37324e2d996676563cb128b9'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:56.949996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f625c0a37324e2d996676563cb128b9'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:56.950624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f625c0a37324e2d996676563cb128b9'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:56.951236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f625c0a37324e2d996676563cb128b9'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:56.965309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f625c0a37324e2d996676563cb128b9'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:56.979604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1108/2232] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:56 2022] DELETE /identity/v3/users/8f625c0a37324e2d996676563cb128b9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:57.153680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba5ce2-ed32-4fb4-ae3f-3c599d46702e service placement] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:57.192809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba5ce2-ed32-4fb4-ae3f-3c599d46702e service placement] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:57.255465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:57.256337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:57.257278 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:57.257568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] PATH_INFO: `/v3/projects/55504664ef8549fd82a7c3d6d399d6b6` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:57.258779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55504664ef8549fd82a7c3d6d399d6b6)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:57.260732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:57.308711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55504664ef8549fd82a7c3d6d399d6b6', 'request_id': 'req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.315768 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55504664ef8549fd82a7c3d6d399d6b6', 'request_id': 'req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.324383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55504664ef8549fd82a7c3d6d399d6b6', 'request_id': 'req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.329120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:57.337331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] The token cache is being invalidate because project 55504664ef8549fd82a7c3d6d399d6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:57.337823 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.338773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.340359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1125/2233] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:57 2022] DELETE /identity/v3/projects/55504664ef8549fd82a7c3d6d399d6b6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:57.344282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:57.345691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:57.358720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3a0f9-99a9-48b7-8a9c-186cdfe29021 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:57.416450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a79f80-74d7-4d58-a57c-a5492b81feca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:57.417349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79f80-74d7-4d58-a57c-a5492b81feca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:57.417640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79f80-74d7-4d58-a57c-a5492b81feca admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:57.417923 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79f80-74d7-4d58-a57c-a5492b81feca admin admin] PATH_INFO: `/v3/users/9c1d3d9a6e3b48a7b941491d0cb5717a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:57.419126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a79f80-74d7-4d58-a57c-a5492b81feca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1d3d9a6e3b48a7b941491d0cb5717a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:57.421184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a79f80-74d7-4d58-a57c-a5492b81feca admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:57.427017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:57.469798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-11a79f80-74d7-4d58-a57c-a5492b81feca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1d3d9a6e3b48a7b941491d0cb5717a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.477565 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-11a79f80-74d7-4d58-a57c-a5492b81feca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1d3d9a6e3b48a7b941491d0cb5717a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.478306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-11a79f80-74d7-4d58-a57c-a5492b81feca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1d3d9a6e3b48a7b941491d0cb5717a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.478932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-11a79f80-74d7-4d58-a57c-a5492b81feca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1d3d9a6e3b48a7b941491d0cb5717a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.492715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-11a79f80-74d7-4d58-a57c-a5492b81feca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1d3d9a6e3b48a7b941491d0cb5717a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.505566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1109/2234] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:57 2022] DELETE /identity/v3/users/9c1d3d9a6e3b48a7b941491d0cb5717a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:57.684738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:57.686179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:57.701641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d67fd-aac8-4c70-9ebe-413f7a44f8b9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:57.758922 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:57.759788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:57.760076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:57.760380 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] PATH_INFO: `/v3/projects/d1ed8b442d3e485ca4c5bea096df065e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:57.761604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ed8b442d3e485ca4c5bea096df065e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:57.763521 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:57.808312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ed8b442d3e485ca4c5bea096df065e', 'request_id': 'req-20007dda-a8ab-48fc-a5cf-b2f610de73a5'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.814376 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ed8b442d3e485ca4c5bea096df065e', 'request_id': 'req-20007dda-a8ab-48fc-a5cf-b2f610de73a5'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.821878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ed8b442d3e485ca4c5bea096df065e', 'request_id': 'req-20007dda-a8ab-48fc-a5cf-b2f610de73a5'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.832191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] The token cache is being invalidate because project d1ed8b442d3e485ca4c5bea096df065e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:57.832476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.834159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-20007dda-a8ab-48fc-a5cf-b2f610de73a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:57.838737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1126/2235] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:57 2022] DELETE /identity/v3/projects/d1ed8b442d3e485ca4c5bea096df065e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:57.843498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ab178-d05e-455f-8aad-721dd714cfb1 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:57.843925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ab178-d05e-455f-8aad-721dd714cfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:57.844101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ab178-d05e-455f-8aad-721dd714cfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:57.862420 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-043ab178-d05e-455f-8aad-721dd714cfb1 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:57.863619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-043ab178-d05e-455f-8aad-721dd714cfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:57.930912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1110/2236] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:57.940273 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af5b75-86bc-4a47-b9fc-79e2338733fe None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:57.940571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af5b75-86bc-4a47-b9fc-79e2338733fe None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:57.941163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af5b75-86bc-4a47-b9fc-79e2338733fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:57.966042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b4af5b75-86bc-4a47-b9fc-79e2338733fe None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:57.967607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b4af5b75-86bc-4a47-b9fc-79e2338733fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:57.968213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ab178-d05e-455f-8aad-721dd714cfb1 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:57.969820 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-043ab178-d05e-455f-8aad-721dd714cfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:57.979775 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1127/2237] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:57.982661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ab178-d05e-455f-8aad-721dd714cfb1 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:57.983912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af5b75-86bc-4a47-b9fc-79e2338733fe None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:57.987399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a837b8-ec9c-4717-aa7a-a9fb039fe821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:57.988266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a837b8-ec9c-4717-aa7a-a9fb039fe821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:57.988553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a837b8-ec9c-4717-aa7a-a9fb039fe821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:57.989043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a837b8-ec9c-4717-aa7a-a9fb039fe821 admin admin] PATH_INFO: `/v3/users/46add921924445e38e54c9a1f71b88ae` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:57.990379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a837b8-ec9c-4717-aa7a-a9fb039fe821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46add921924445e38e54c9a1f71b88ae)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:57.992304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a837b8-ec9c-4717-aa7a-a9fb039fe821 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:57.993590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af5b75-86bc-4a47-b9fc-79e2338733fe None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:57.998928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78d3c9-8823-4731-b0d5-079bc98681f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:57.999563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78d3c9-8823-4731-b0d5-079bc98681f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:57.999844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78d3c9-8823-4731-b0d5-079bc98681f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.000116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78d3c9-8823-4731-b0d5-079bc98681f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.000877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78d3c9-8823-4731-b0d5-079bc98681f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:58.001186 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78d3c9-8823-4731-b0d5-079bc98681f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.002858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78d3c9-8823-4731-b0d5-079bc98681f7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.016204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1128/2238] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:14:58.021814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78d3c9-8823-4731-b0d5-079bc98681f7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.032162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78d3c9-8823-4731-b0d5-079bc98681f7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.037196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ad93c-8606-4239-9ff6-3957b8454803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.037844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ad93c-8606-4239-9ff6-3957b8454803 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.038135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ad93c-8606-4239-9ff6-3957b8454803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.038415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ad93c-8606-4239-9ff6-3957b8454803 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.039134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ad93c-8606-4239-9ff6-3957b8454803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.041081 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ad93c-8606-4239-9ff6-3957b8454803 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.041388 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-80a837b8-ec9c-4717-aa7a-a9fb039fe821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46add921924445e38e54c9a1f71b88ae'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.048895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-80a837b8-ec9c-4717-aa7a-a9fb039fe821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46add921924445e38e54c9a1f71b88ae'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.049712 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-80a837b8-ec9c-4717-aa7a-a9fb039fe821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46add921924445e38e54c9a1f71b88ae'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.050355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-80a837b8-ec9c-4717-aa7a-a9fb039fe821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46add921924445e38e54c9a1f71b88ae'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.063404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-80a837b8-ec9c-4717-aa7a-a9fb039fe821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46add921924445e38e54c9a1f71b88ae'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.071496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1129/2239] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:58 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:58.072541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:58.072708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ad93c-8606-4239-9ff6-3957b8454803 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.074525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b77ad93c-8606-4239-9ff6-3957b8454803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:58.077865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1111/2240] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:57 2022] DELETE /identity/v3/users/46add921924445e38e54c9a1f71b88ae => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:58.083474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dbcdc-8050-4de9-b82a-72cf21daea0c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.084013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dbcdc-8050-4de9-b82a-72cf21daea0c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.084465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dbcdc-8050-4de9-b82a-72cf21daea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.101891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ed2dbcdc-8050-4de9-b82a-72cf21daea0c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:58.103098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ed2dbcdc-8050-4de9-b82a-72cf21daea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:58.124359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:58.154814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ad93c-8606-4239-9ff6-3957b8454803 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.171200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1112/2241] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:58.181049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dbcdc-8050-4de9-b82a-72cf21daea0c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.182418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ed2dbcdc-8050-4de9-b82a-72cf21daea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:58.218964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a03fdf-c9a3-47da-95bc-fc4acff985a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.220008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a03fdf-c9a3-47da-95bc-fc4acff985a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.220008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a03fdf-c9a3-47da-95bc-fc4acff985a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.220230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a03fdf-c9a3-47da-95bc-fc4acff985a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.220941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a03fdf-c9a3-47da-95bc-fc4acff985a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.222904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a03fdf-c9a3-47da-95bc-fc4acff985a3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.256490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dbcdc-8050-4de9-b82a-72cf21daea0c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.261682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8709b9-a9fe-4add-a3dc-0775bfb7d719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.263638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8709b9-a9fe-4add-a3dc-0775bfb7d719 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.263912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8709b9-a9fe-4add-a3dc-0775bfb7d719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.264187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8709b9-a9fe-4add-a3dc-0775bfb7d719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.268720 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1130/2242] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:58 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:58.272644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a03fdf-c9a3-47da-95bc-fc4acff985a3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.276339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8709b9-a9fe-4add-a3dc-0775bfb7d719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.277936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8709b9-a9fe-4add-a3dc-0775bfb7d719 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.284266 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a03fdf-c9a3-47da-95bc-fc4acff985a3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.289565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bf0a4-ceb1-4c0f-a3aa-91eabfea6924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.290533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bf0a4-ceb1-4c0f-a3aa-91eabfea6924 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.290651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1113/2243] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:58.290744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bf0a4-ceb1-4c0f-a3aa-91eabfea6924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.291096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bf0a4-ceb1-4c0f-a3aa-91eabfea6924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.291920 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bf0a4-ceb1-4c0f-a3aa-91eabfea6924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.293651 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bf0a4-ceb1-4c0f-a3aa-91eabfea6924 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.304792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1131/2244] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:58.308791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8709b9-a9fe-4add-a3dc-0775bfb7d719 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.318627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8709b9-a9fe-4add-a3dc-0775bfb7d719 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.325711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6adb2-3d8e-4a6a-8c0c-94d2136bec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.326514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6adb2-3d8e-4a6a-8c0c-94d2136bec2d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.326897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6adb2-3d8e-4a6a-8c0c-94d2136bec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.327277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6adb2-3d8e-4a6a-8c0c-94d2136bec2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.328115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6adb2-3d8e-4a6a-8c0c-94d2136bec2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.330004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6adb2-3d8e-4a6a-8c0c-94d2136bec2d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.345299 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1114/2245] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:58.351306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bf0a4-ceb1-4c0f-a3aa-91eabfea6924 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.361938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bf0a4-ceb1-4c0f-a3aa-91eabfea6924 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.368223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ab5c2-2103-4a12-a6da-296c36e32718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.369191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ab5c2-2103-4a12-a6da-296c36e32718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.369442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ab5c2-2103-4a12-a6da-296c36e32718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.369722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ab5c2-2103-4a12-a6da-296c36e32718 admin admin] PATH_INFO: `/v3/projects/c0d1d0cfb37247fbbcdfc6f39fbafa82/users/da0577e1686143f88643dcfddb92ff70/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.392396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ab5c2-2103-4a12-a6da-296c36e32718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d1d0cfb37247fbbcdfc6f39fbafa82, user_id=da0577e1686143f88643dcfddb92ff70, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.392396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ab5c2-2103-4a12-a6da-296c36e32718 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.411608 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1132/2246] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:58 2022] PUT /identity/v3/projects/c0d1d0cfb37247fbbcdfc6f39fbafa82/users/da0577e1686143f88643dcfddb92ff70/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:58.420189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e32449-ee48-43c2-b2c1-5d5da784e317 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.420483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e32449-ee48-43c2-b2c1-5d5da784e317 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.420794 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e32449-ee48-43c2-b2c1-5d5da784e317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.458061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-60e32449-ee48-43c2-b2c1-5d5da784e317 None None] MFA Rules not processed for user `da0577e1686143f88643dcfddb92ff70`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:58.459487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-60e32449-ee48-43c2-b2c1-5d5da784e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:58.540665 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1115/2247] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:58.545340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ab5c2-2103-4a12-a6da-296c36e32718 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.612584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ab5c2-2103-4a12-a6da-296c36e32718 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.624027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb23fa0-ba34-4704-bf3f-8ec18798e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.624027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23fa0-ba34-4704-bf3f-8ec18798e91c admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.624027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23fa0-ba34-4704-bf3f-8ec18798e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.624027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23fa0-ba34-4704-bf3f-8ec18798e91c admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.624426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb23fa0-ba34-4704-bf3f-8ec18798e91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.624426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb23fa0-ba34-4704-bf3f-8ec18798e91c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.678823 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1133/2248] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:58 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:58.682861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e32449-ee48-43c2-b2c1-5d5da784e317 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.700761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e32449-ee48-43c2-b2c1-5d5da784e317 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.724793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:58.773751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb23fa0-ba34-4704-bf3f-8ec18798e91c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.775544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1fb23fa0-ba34-4704-bf3f-8ec18798e91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:58.790004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8c731-5c08-400a-a682-9e66fe1f3a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.790826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c731-5c08-400a-a682-9e66fe1f3a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.791187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c731-5c08-400a-a682-9e66fe1f3a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.791562 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c731-5c08-400a-a682-9e66fe1f3a61 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.792365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8c731-5c08-400a-a682-9e66fe1f3a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.795352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8c731-5c08-400a-a682-9e66fe1f3a61 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.829343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1116/2249] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:58 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:58.833220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8c731-5c08-400a-a682-9e66fe1f3a61 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.841778 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:58.844570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8c731-5c08-400a-a682-9e66fe1f3a61 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.851217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae56b43-3d06-419e-b5ff-92848f4ac452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.851938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae56b43-3d06-419e-b5ff-92848f4ac452 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.852202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae56b43-3d06-419e-b5ff-92848f4ac452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.852550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae56b43-3d06-419e-b5ff-92848f4ac452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.853397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae56b43-3d06-419e-b5ff-92848f4ac452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.855700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae56b43-3d06-419e-b5ff-92848f4ac452 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.872065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1117/2250] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:58.873104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae56b43-3d06-419e-b5ff-92848f4ac452 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.888666 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb23fa0-ba34-4704-bf3f-8ec18798e91c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.897016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.898172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.898563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.899151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] PATH_INFO: `/v3/projects/fe4c3f3e847d447dacbf448dfd567f88` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.900553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4c3f3e847d447dacbf448dfd567f88)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.901649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae56b43-3d06-419e-b5ff-92848f4ac452 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.902741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.910387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e85ab-2476-4a37-b4f9-83eb97505a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.912004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e85ab-2476-4a37-b4f9-83eb97505a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.912004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e85ab-2476-4a37-b4f9-83eb97505a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.912288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e85ab-2476-4a37-b4f9-83eb97505a70 admin admin] PATH_INFO: `/v3/projects/67a04619aa024d2f9f3687abe4228370/users/7eab7288d4b345e7bf135dbe0d12a67f/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.951412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e85ab-2476-4a37-b4f9-83eb97505a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a04619aa024d2f9f3687abe4228370, user_id=7eab7288d4b345e7bf135dbe0d12a67f, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.954572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e85ab-2476-4a37-b4f9-83eb97505a70 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.966498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4c3f3e847d447dacbf448dfd567f88', 'request_id': 'req-e7ce5000-3207-489c-badf-9b080acb3709'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.971793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1118/2251] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:58 2022] PUT /identity/v3/projects/67a04619aa024d2f9f3687abe4228370/users/7eab7288d4b345e7bf135dbe0d12a67f/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:58.973490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4c3f3e847d447dacbf448dfd567f88', 'request_id': 'req-e7ce5000-3207-489c-badf-9b080acb3709'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.976313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e85ab-2476-4a37-b4f9-83eb97505a70 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.981179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4c3f3e847d447dacbf448dfd567f88', 'request_id': 'req-e7ce5000-3207-489c-badf-9b080acb3709'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.992994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] The token cache is being invalidate because project fe4c3f3e847d447dacbf448dfd567f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:58.993283 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.993933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.995749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1134/2252] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:58 2022] DELETE /identity/v3/projects/fe4c3f3e847d447dacbf448dfd567f88 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:58.999290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:59.000695 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:59.046737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e85ab-2476-4a37-b4f9-83eb97505a70 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.051940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3d69d-9f8d-472e-a3c5-2c68661d2003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.052626 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3d69d-9f8d-472e-a3c5-2c68661d2003 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.052936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3d69d-9f8d-472e-a3c5-2c68661d2003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.053218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3d69d-9f8d-472e-a3c5-2c68661d2003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.053960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3d69d-9f8d-472e-a3c5-2c68661d2003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.055652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3d69d-9f8d-472e-a3c5-2c68661d2003 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.066680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1119/2253] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:59.070912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3d69d-9f8d-472e-a3c5-2c68661d2003 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:59.072688 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b4e3d69d-9f8d-472e-a3c5-2c68661d2003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:59.073436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce5000-3207-489c-badf-9b080acb3709 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.078412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.079363 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.079679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.079987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] PATH_INFO: `/v3/users/5da5597b770143c6ac63d6566b84dcc7` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.081367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da5597b770143c6ac63d6566b84dcc7)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.084073 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.086026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3d69d-9f8d-472e-a3c5-2c68661d2003 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.090682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cf3f1-9534-4e31-baa5-5bb85676e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.091882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cf3f1-9534-4e31-baa5-5bb85676e648 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.092297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cf3f1-9534-4e31-baa5-5bb85676e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.092589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cf3f1-9534-4e31-baa5-5bb85676e648 admin admin] PATH_INFO: `/v3/projects/67a04619aa024d2f9f3687abe4228370/users/7eab7288d4b345e7bf135dbe0d12a67f/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.095394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cf3f1-9534-4e31-baa5-5bb85676e648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a04619aa024d2f9f3687abe4228370, user_id=7eab7288d4b345e7bf135dbe0d12a67f, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.098733 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cf3f1-9534-4e31-baa5-5bb85676e648 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.111580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1120/2254] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:59 2022] PUT /identity/v3/projects/67a04619aa024d2f9f3687abe4228370/users/7eab7288d4b345e7bf135dbe0d12a67f/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:59.124467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27ea45-6b78-4e4f-a25f-c15166957d73 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.124852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27ea45-6b78-4e4f-a25f-c15166957d73 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.125130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27ea45-6b78-4e4f-a25f-c15166957d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.137285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da5597b770143c6ac63d6566b84dcc7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:59.145464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da5597b770143c6ac63d6566b84dcc7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:59.146202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da5597b770143c6ac63d6566b84dcc7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:59.146801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da5597b770143c6ac63d6566b84dcc7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:59.152306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:59.154195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9d27ea45-6b78-4e4f-a25f-c15166957d73 None None] MFA Rules not processed for user `7eab7288d4b345e7bf135dbe0d12a67f`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:59.155482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9d27ea45-6b78-4e4f-a25f-c15166957d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:59.162633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da5597b770143c6ac63d6566b84dcc7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:59.181381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1135/2255] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:58 2022] DELETE /identity/v3/users/5da5597b770143c6ac63d6566b84dcc7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:59.210209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:59.242032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1121/2256] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:59.253729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:59.256234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:59.360394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa50cf2-7b0c-4f90-aab6-7a0052690d7b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.365526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a3567-c372-407e-977f-f05897541752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.365951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a3567-c372-407e-977f-f05897541752 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.366243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a3567-c372-407e-977f-f05897541752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.366532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a3567-c372-407e-977f-f05897541752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.368528 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-572a3567-c372-407e-977f-f05897541752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:59.444251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a3567-c372-407e-977f-f05897541752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.446001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a3567-c372-407e-977f-f05897541752 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.456482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1136/2257] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:59.525454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27ea45-6b78-4e4f-a25f-c15166957d73 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:59.527673 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9d27ea45-6b78-4e4f-a25f-c15166957d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:59.652183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27ea45-6b78-4e4f-a25f-c15166957d73 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.735444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.736319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.736600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.736933 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] PATH_INFO: `/v3/projects/db8cd970c45c4ff6a58807af94b10847` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.738269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8cd970c45c4ff6a58807af94b10847)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.741181 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.816219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8cd970c45c4ff6a58807af94b10847', 'request_id': 'req-312a6916-24d0-458e-9f2b-d9232b52569d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:59.825366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8cd970c45c4ff6a58807af94b10847', 'request_id': 'req-312a6916-24d0-458e-9f2b-d9232b52569d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:59.833412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8cd970c45c4ff6a58807af94b10847', 'request_id': 'req-312a6916-24d0-458e-9f2b-d9232b52569d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:59.852830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] The token cache is being invalidate because project db8cd970c45c4ff6a58807af94b10847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:59.853436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:59.853996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-312a6916-24d0-458e-9f2b-d9232b52569d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:59.855899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1122/2258] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:59 2022] DELETE /identity/v3/projects/db8cd970c45c4ff6a58807af94b10847 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:59.862159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955825f-c38c-465b-b281-8d458b5498cd None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.862609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955825f-c38c-465b-b281-8d458b5498cd None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.862867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955825f-c38c-465b-b281-8d458b5498cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.883940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5955825f-c38c-465b-b281-8d458b5498cd None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:59.885431 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5955825f-c38c-465b-b281-8d458b5498cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:59.948661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1137/2259] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:59.958729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9ff53-528f-4e43-9c22-4caf58bdce7a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.959025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9ff53-528f-4e43-9c22-4caf58bdce7a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.959311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9ff53-528f-4e43-9c22-4caf58bdce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.979950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2ca9ff53-528f-4e43-9c22-4caf58bdce7a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:59.981221 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2ca9ff53-528f-4e43-9c22-4caf58bdce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:59.991877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1123/2260] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:59.994391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a45eae-de45-4228-b165-98028d206a93 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.994686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a45eae-de45-4228-b165-98028d206a93 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.995209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a45eae-de45-4228-b165-98028d206a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.995809 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9ff53-528f-4e43-9c22-4caf58bdce7a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:00.005992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9ff53-528f-4e43-9c22-4caf58bdce7a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:00.010678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e7f34-b4f7-42f8-9ece-45053007e4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:00.011330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e7f34-b4f7-42f8-9ece-45053007e4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:00.011663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e7f34-b4f7-42f8-9ece-45053007e4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:00.011942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e7f34-b4f7-42f8-9ece-45053007e4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:00.012827 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e7f34-b4f7-42f8-9ece-45053007e4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:15:00.013204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e7f34-b4f7-42f8-9ece-45053007e4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:00.013443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-87a45eae-de45-4228-b165-98028d206a93 None None] MFA Rules not processed for user `eda7e570a1b54240b8f956cccc498f06`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:00.014660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-87a45eae-de45-4228-b165-98028d206a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:00.014820 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e7f34-b4f7-42f8-9ece-45053007e4e7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:00.026404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:00.030447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1124/2261] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:15:00.034921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e7f34-b4f7-42f8-9ece-45053007e4e7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:00.046987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e7f34-b4f7-42f8-9ece-45053007e4e7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:00.048969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:00.053115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fc140-2661-4ad8-92a2-79d6ff21b6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:00.053812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc140-2661-4ad8-92a2-79d6ff21b6fb admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:00.054968 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc140-2661-4ad8-92a2-79d6ff21b6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:00.054968 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fc140-2661-4ad8-92a2-79d6ff21b6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:00.055204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fc140-2661-4ad8-92a2-79d6ff21b6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:00.057161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fc140-2661-4ad8-92a2-79d6ff21b6fb admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:00.081672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1138/2262] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:14:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:00.087306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1125/2263] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:00 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:15:00.091312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a45eae-de45-4228-b165-98028d206a93 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:00.102841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a45eae-de45-4228-b165-98028d206a93 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:00.168794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74db70-7c5f-49bd-aa37-c2d46495ef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:00.169480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74db70-7c5f-49bd-aa37-c2d46495ef84 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:00.169769 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74db70-7c5f-49bd-aa37-c2d46495ef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:00.170051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74db70-7c5f-49bd-aa37-c2d46495ef84 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:00.170754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74db70-7c5f-49bd-aa37-c2d46495ef84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:00.172820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74db70-7c5f-49bd-aa37-c2d46495ef84 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:00.194548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1139/2264] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:00 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:00.198522 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fc140-2661-4ad8-92a2-79d6ff21b6fb admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:00.211034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fc140-2661-4ad8-92a2-79d6ff21b6fb admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:00.216765 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3c572-8e40-4e9a-803a-8b8d7bde49a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:00.217444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c572-8e40-4e9a-803a-8b8d7bde49a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:00.217738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c572-8e40-4e9a-803a-8b8d7bde49a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:00.218020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c572-8e40-4e9a-803a-8b8d7bde49a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:00.218799 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3c572-8e40-4e9a-803a-8b8d7bde49a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:00.220494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3c572-8e40-4e9a-803a-8b8d7bde49a8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:00.231588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1126/2265] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:00.235602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74db70-7c5f-49bd-aa37-c2d46495ef84 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:00.246697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74db70-7c5f-49bd-aa37-c2d46495ef84 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:00.251564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121e486-34b1-4893-966f-29383537f52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:00.252250 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121e486-34b1-4893-966f-29383537f52a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:00.252536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121e486-34b1-4893-966f-29383537f52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:00.252852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121e486-34b1-4893-966f-29383537f52a admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:00.253654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121e486-34b1-4893-966f-29383537f52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:00.255566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121e486-34b1-4893-966f-29383537f52a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:00.269681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1140/2266] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:00.270811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3c572-8e40-4e9a-803a-8b8d7bde49a8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:00.281778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3c572-8e40-4e9a-803a-8b8d7bde49a8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:00.293741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93758e9e-0608-4e80-a047-a4396c91d5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:00.294864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758e9e-0608-4e80-a047-a4396c91d5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:00.294983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758e9e-0608-4e80-a047-a4396c91d5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:00.295275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758e9e-0608-4e80-a047-a4396c91d5d9 admin admin] PATH_INFO: `/v3/projects/5f427d7e2ab74fd6bdfd34d06ede35cb/users/86c73edacaa14a54a0ae954ba209dddc/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:00.311653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93758e9e-0608-4e80-a047-a4396c91d5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f427d7e2ab74fd6bdfd34d06ede35cb, user_id=86c73edacaa14a54a0ae954ba209dddc, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:00.314394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93758e9e-0608-4e80-a047-a4396c91d5d9 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:00.328666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1127/2267] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:00 2022] PUT /identity/v3/projects/5f427d7e2ab74fd6bdfd34d06ede35cb/users/86c73edacaa14a54a0ae954ba209dddc/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:15:00.339649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a27a70-b731-4772-984d-ce57c9e72c63 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:00.339937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a27a70-b731-4772-984d-ce57c9e72c63 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:00.340214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a27a70-b731-4772-984d-ce57c9e72c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:00.368141 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-83a27a70-b731-4772-984d-ce57c9e72c63 None None] MFA Rules not processed for user `86c73edacaa14a54a0ae954ba209dddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:00.369384 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-83a27a70-b731-4772-984d-ce57c9e72c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:00.438173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1141/2268] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:00.450410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93758e9e-0608-4e80-a047-a4396c91d5d9 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:00.452110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-93758e9e-0608-4e80-a047-a4396c91d5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:00.509949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93758e9e-0608-4e80-a047-a4396c91d5d9 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:00.520851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841befa-2139-4f61-8ba1-0892b9588f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:00.521562 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841befa-2139-4f61-8ba1-0892b9588f2d service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:00.521851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841befa-2139-4f61-8ba1-0892b9588f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:00.522138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841befa-2139-4f61-8ba1-0892b9588f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:00.531714 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841befa-2139-4f61-8ba1-0892b9588f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:00.533201 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841befa-2139-4f61-8ba1-0892b9588f2d service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:00.543524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1128/2269] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:00.828625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a27a70-b731-4772-984d-ce57c9e72c63 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:00.830365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-83a27a70-b731-4772-984d-ce57c9e72c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:00.982883 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:01.014286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a27a70-b731-4772-984d-ce57c9e72c63 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:01.019852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:01.021611 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:01.021881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:01.022211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] PATH_INFO: `/v3/users/e6413e4d77064c48a8ecffda215679ad` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:01.023693 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6413e4d77064c48a8ecffda215679ad)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:01.026067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:01.092755 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6413e4d77064c48a8ecffda215679ad'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:01.101286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6413e4d77064c48a8ecffda215679ad'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:01.102624 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6413e4d77064c48a8ecffda215679ad'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:01.103323 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6413e4d77064c48a8ecffda215679ad'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:01.116631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6413e4d77064c48a8ecffda215679ad'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:01.132748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1142/2270] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:00 2022] DELETE /identity/v3/users/e6413e4d77064c48a8ecffda215679ad => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:01.137032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b97936-7b46-4101-bb30-67bece6657fa None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:01.138349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b97936-7b46-4101-bb30-67bece6657fa None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:01.138979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b97936-7b46-4101-bb30-67bece6657fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:01.161830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a3b97936-7b46-4101-bb30-67bece6657fa None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:01.163194 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a3b97936-7b46-4101-bb30-67bece6657fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:01.227630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1129/2271] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:01.237094 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:01.238516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:01.302929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c67f4-ee2b-4081-9b61-de6591c49f76 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:01.306706 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4fb48-fc13-4590-8e4d-c348d535eb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:01.307372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4fb48-fc13-4590-8e4d-c348d535eb5b service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:01.307663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4fb48-fc13-4590-8e4d-c348d535eb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:01.307944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4fb48-fc13-4590-8e4d-c348d535eb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:01.320542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4fb48-fc13-4590-8e4d-c348d535eb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:01.322240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4fb48-fc13-4590-8e4d-c348d535eb5b service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:01.335878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1143/2272] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:01.625851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b97936-7b46-4101-bb30-67bece6657fa None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:01.627600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a3b97936-7b46-4101-bb30-67bece6657fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:01.641394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b97936-7b46-4101-bb30-67bece6657fa None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:01.646617 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:01.647480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:01.647766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:01.648042 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] PATH_INFO: `/v3/projects/86db0de5e0ae4c1197a7662cb71bf9af` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:01.649478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86db0de5e0ae4c1197a7662cb71bf9af)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:01.651991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:01.696225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:01.703930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86db0de5e0ae4c1197a7662cb71bf9af', 'request_id': 'req-02bbf644-148f-4986-9c52-945a93bc57f5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:01.710492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86db0de5e0ae4c1197a7662cb71bf9af', 'request_id': 'req-02bbf644-148f-4986-9c52-945a93bc57f5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:01.716143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86db0de5e0ae4c1197a7662cb71bf9af', 'request_id': 'req-02bbf644-148f-4986-9c52-945a93bc57f5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:01.730441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] The token cache is being invalidate because project 86db0de5e0ae4c1197a7662cb71bf9af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:01.730769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:01.731424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-02bbf644-148f-4986-9c52-945a93bc57f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:01.736147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1130/2273] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:01 2022] DELETE /identity/v3/projects/86db0de5e0ae4c1197a7662cb71bf9af => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:01.737743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937c24b-5c5d-416e-94dd-447beb10967a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:01.738034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937c24b-5c5d-416e-94dd-447beb10967a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:01.739428 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937c24b-5c5d-416e-94dd-447beb10967a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:01.767890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3937c24b-5c5d-416e-94dd-447beb10967a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:01.769392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3937c24b-5c5d-416e-94dd-447beb10967a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:01.844145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1144/2274] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:01.853388 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf674-3b43-4628-a078-f686a8588fd6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:01.853682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf674-3b43-4628-a078-f686a8588fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:01.853968 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf674-3b43-4628-a078-f686a8588fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:01.873920 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e57cf674-3b43-4628-a078-f686a8588fd6 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:01.875210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e57cf674-3b43-4628-a078-f686a8588fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:01.886199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1131/2275] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:01.892138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937c24b-5c5d-416e-94dd-447beb10967a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:01.908015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937c24b-5c5d-416e-94dd-447beb10967a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:01.914949 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d5569-5315-4cd2-a208-10c7399b3e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:01.915636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d5569-5315-4cd2-a208-10c7399b3e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:01.916069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d5569-5315-4cd2-a208-10c7399b3e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:01.916352 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d5569-5315-4cd2-a208-10c7399b3e5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:01.917150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d5569-5315-4cd2-a208-10c7399b3e5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:15:01.917453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d5569-5315-4cd2-a208-10c7399b3e5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:01.919097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d5569-5315-4cd2-a208-10c7399b3e5f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:01.928440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:01.941444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1145/2276] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:15:01.943527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cf674-3b43-4628-a078-f686a8588fd6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:01.955897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cf674-3b43-4628-a078-f686a8588fd6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:01.963887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940e542-5dc3-4877-a618-dbc2ef390e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:01.964661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940e542-5dc3-4877-a618-dbc2ef390e1a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:01.965028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940e542-5dc3-4877-a618-dbc2ef390e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:01.965414 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940e542-5dc3-4877-a618-dbc2ef390e1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:01.966351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940e542-5dc3-4877-a618-dbc2ef390e1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:01.968785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940e542-5dc3-4877-a618-dbc2ef390e1a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:02.010485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1132/2277] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:01 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:02.014751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d5569-5315-4cd2-a208-10c7399b3e5f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:02.032363 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d5569-5315-4cd2-a208-10c7399b3e5f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:02.155001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635155a9-ac8f-46cb-be49-1f5e2bbb3a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:02.155885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635155a9-ac8f-46cb-be49-1f5e2bbb3a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:02.156235 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635155a9-ac8f-46cb-be49-1f5e2bbb3a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:02.156440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635155a9-ac8f-46cb-be49-1f5e2bbb3a2c admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:02.157239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635155a9-ac8f-46cb-be49-1f5e2bbb3a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:02.159438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635155a9-ac8f-46cb-be49-1f5e2bbb3a2c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:02.199241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1146/2278] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:02 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:15:02.202948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940e542-5dc3-4877-a618-dbc2ef390e1a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:02.211366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635155a9-ac8f-46cb-be49-1f5e2bbb3a2c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:02.214152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-635155a9-ac8f-46cb-be49-1f5e2bbb3a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:02.224294 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940e542-5dc3-4877-a618-dbc2ef390e1a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:02.233705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635155a9-ac8f-46cb-be49-1f5e2bbb3a2c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:02.240301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf522ca4-9ff3-46f9-8b18-3b76b72bcac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:02.241223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf522ca4-9ff3-46f9-8b18-3b76b72bcac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:02.241664 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf522ca4-9ff3-46f9-8b18-3b76b72bcac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:02.242115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf522ca4-9ff3-46f9-8b18-3b76b72bcac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:02.243305 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf522ca4-9ff3-46f9-8b18-3b76b72bcac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:02.244341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fd310-93ba-4566-a5b6-87356bb3c8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:02.245296 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fd310-93ba-4566-a5b6-87356bb3c8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:02.245711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fd310-93ba-4566-a5b6-87356bb3c8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:02.245862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fd310-93ba-4566-a5b6-87356bb3c8e1 admin admin] PATH_INFO: `/v3/users/da0577e1686143f88643dcfddb92ff70` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:02.246179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf522ca4-9ff3-46f9-8b18-3b76b72bcac8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:02.247328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fd310-93ba-4566-a5b6-87356bb3c8e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0577e1686143f88643dcfddb92ff70)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:02.249460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fd310-93ba-4566-a5b6-87356bb3c8e1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:02.262959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1133/2279] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:02.268402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf522ca4-9ff3-46f9-8b18-3b76b72bcac8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:02.291407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf522ca4-9ff3-46f9-8b18-3b76b72bcac8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:02.299437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf297e51-9b00-4dda-9fca-ab665f42ae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:02.300315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297e51-9b00-4dda-9fca-ab665f42ae8b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:02.300737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297e51-9b00-4dda-9fca-ab665f42ae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:02.301032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297e51-9b00-4dda-9fca-ab665f42ae8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:02.301960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf297e51-9b00-4dda-9fca-ab665f42ae8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:02.303630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf297e51-9b00-4dda-9fca-ab665f42ae8b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:02.321205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1134/2280] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:02.322651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf297e51-9b00-4dda-9fca-ab665f42ae8b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:02.336053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf297e51-9b00-4dda-9fca-ab665f42ae8b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:02.347374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-342fd310-93ba-4566-a5b6-87356bb3c8e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0577e1686143f88643dcfddb92ff70'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:02.348306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14448ca7-91be-4cd6-a6e5-dc8f9ee55582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:02.349728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448ca7-91be-4cd6-a6e5-dc8f9ee55582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:02.350014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448ca7-91be-4cd6-a6e5-dc8f9ee55582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:02.350303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14448ca7-91be-4cd6-a6e5-dc8f9ee55582 admin admin] PATH_INFO: `/v3/projects/2d4a23d5a592413c8f70004addd84bc3/users/7b1b18cb8a2447caaba2fd3d481c7303/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:02.357492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-342fd310-93ba-4566-a5b6-87356bb3c8e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0577e1686143f88643dcfddb92ff70'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:02.358218 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-342fd310-93ba-4566-a5b6-87356bb3c8e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0577e1686143f88643dcfddb92ff70'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:02.358842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-342fd310-93ba-4566-a5b6-87356bb3c8e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0577e1686143f88643dcfddb92ff70'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:02.370462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14448ca7-91be-4cd6-a6e5-dc8f9ee55582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4a23d5a592413c8f70004addd84bc3, user_id=7b1b18cb8a2447caaba2fd3d481c7303, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:02.373419 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14448ca7-91be-4cd6-a6e5-dc8f9ee55582 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:02.374077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-342fd310-93ba-4566-a5b6-87356bb3c8e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0577e1686143f88643dcfddb92ff70'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:02.388239 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1135/2281] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:02 2022] PUT /identity/v3/projects/2d4a23d5a592413c8f70004addd84bc3/users/7b1b18cb8a2447caaba2fd3d481c7303/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:02.391055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1147/2282] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:02 2022] DELETE /identity/v3/users/da0577e1686143f88643dcfddb92ff70 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:02.396178 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80afb1c-a1f4-4bf7-a985-538cca277bf0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:02.396891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80afb1c-a1f4-4bf7-a985-538cca277bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:02.397330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80afb1c-a1f4-4bf7-a985-538cca277bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:02.399594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251a56-e2be-423d-9114-fe36c3e189e8 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:02.399914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251a56-e2be-423d-9114-fe36c3e189e8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:02.400196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251a56-e2be-423d-9114-fe36c3e189e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:02.423276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a80afb1c-a1f4-4bf7-a985-538cca277bf0 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:02.424254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a80afb1c-a1f4-4bf7-a985-538cca277bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:02.432142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-fa251a56-e2be-423d-9114-fe36c3e189e8 None None] MFA Rules not processed for user `7b1b18cb8a2447caaba2fd3d481c7303`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:02.433958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fa251a56-e2be-423d-9114-fe36c3e189e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:02.490997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:02.502180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1136/2283] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:02.512490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1148/2284] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:02.517680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80afb1c-a1f4-4bf7-a985-538cca277bf0 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:02.519682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a80afb1c-a1f4-4bf7-a985-538cca277bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:02.524415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa251a56-e2be-423d-9114-fe36c3e189e8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:02.526008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fa251a56-e2be-423d-9114-fe36c3e189e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:02.591820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa251a56-e2be-423d-9114-fe36c3e189e8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:02.592564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80afb1c-a1f4-4bf7-a985-538cca277bf0 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:02.596346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34ab68-6d22-41b2-be00-4b979a1a0534 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3780488ee9404b3b8eda52acf8dceca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:02.597051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ab68-6d22-41b2-be00-4b979a1a0534 service glance] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:02.597394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ab68-6d22-41b2-be00-4b979a1a0534 service glance] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:02.598242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ab68-6d22-41b2-be00-4b979a1a0534 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:02.598360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8975811-ab59-4ea9-b2f2-7921290c2fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:02.599261 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975811-ab59-4ea9-b2f2-7921290c2fca service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:02.599550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975811-ab59-4ea9-b2f2-7921290c2fca service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:02.599829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975811-ab59-4ea9-b2f2-7921290c2fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:02.608423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34ab68-6d22-41b2-be00-4b979a1a0534 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:02.610182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34ab68-6d22-41b2-be00-4b979a1a0534 service glance] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:02.611804 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8975811-ab59-4ea9-b2f2-7921290c2fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:02.613479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8975811-ab59-4ea9-b2f2-7921290c2fca service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:02.619216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:02.628536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1137/2285] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:15:02.637538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1149/2286] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:15:03.075292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8975811-ab59-4ea9-b2f2-7921290c2fca service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:03.077773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b8975811-ab59-4ea9-b2f2-7921290c2fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:03.096343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8975811-ab59-4ea9-b2f2-7921290c2fca service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:03.101883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:03.102764 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:03.103080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:03.103373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] PATH_INFO: `/v3/projects/c0d1d0cfb37247fbbcdfc6f39fbafa82` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:03.104549 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d1d0cfb37247fbbcdfc6f39fbafa82)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:03.106497 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:03.164987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d1d0cfb37247fbbcdfc6f39fbafa82', 'request_id': 'req-a2630ccc-38a3-4a1b-92d4-57b4e3455646'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:03.171661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d1d0cfb37247fbbcdfc6f39fbafa82', 'request_id': 'req-a2630ccc-38a3-4a1b-92d4-57b4e3455646'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:03.178406 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d1d0cfb37247fbbcdfc6f39fbafa82', 'request_id': 'req-a2630ccc-38a3-4a1b-92d4-57b4e3455646'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:03.191378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] The token cache is being invalidate because project c0d1d0cfb37247fbbcdfc6f39fbafa82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:03.191664 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:03.193335 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:03.194911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1138/2287] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:03 2022] DELETE /identity/v3/projects/c0d1d0cfb37247fbbcdfc6f39fbafa82 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:03.198782 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34ab68-6d22-41b2-be00-4b979a1a0534 service glance] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:03.210684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34ab68-6d22-41b2-be00-4b979a1a0534 service glance] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:03.266451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fcc4e-36f2-4895-b346-b400b2fab390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:03.267339 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fcc4e-36f2-4895-b346-b400b2fab390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:03.267630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fcc4e-36f2-4895-b346-b400b2fab390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:03.267922 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fcc4e-36f2-4895-b346-b400b2fab390 admin admin] PATH_INFO: `/v3/users/7eab7288d4b345e7bf135dbe0d12a67f` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:03.269157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fcc4e-36f2-4895-b346-b400b2fab390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eab7288d4b345e7bf135dbe0d12a67f)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:03.271750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fcc4e-36f2-4895-b346-b400b2fab390 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:03.320382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f86fcc4e-36f2-4895-b346-b400b2fab390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eab7288d4b345e7bf135dbe0d12a67f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:03.328704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f86fcc4e-36f2-4895-b346-b400b2fab390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eab7288d4b345e7bf135dbe0d12a67f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:03.329412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f86fcc4e-36f2-4895-b346-b400b2fab390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eab7288d4b345e7bf135dbe0d12a67f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:03.330451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f86fcc4e-36f2-4895-b346-b400b2fab390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eab7288d4b345e7bf135dbe0d12a67f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:03.350038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f86fcc4e-36f2-4895-b346-b400b2fab390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eab7288d4b345e7bf135dbe0d12a67f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:03.369751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1150/2288] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:03 2022] DELETE /identity/v3/users/7eab7288d4b345e7bf135dbe0d12a67f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:04.064572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:04.066146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:04.080061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2630ccc-38a3-4a1b-92d4-57b4e3455646 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:04.175173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:04.178718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.179613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.180053 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] PATH_INFO: `/v3/projects/67a04619aa024d2f9f3687abe4228370` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.181932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a04619aa024d2f9f3687abe4228370)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:04.184454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:04.253806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a04619aa024d2f9f3687abe4228370', 'request_id': 'req-109bc188-f0e6-48a9-bd74-0ad756b7ac60'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:04.261565 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a04619aa024d2f9f3687abe4228370', 'request_id': 'req-109bc188-f0e6-48a9-bd74-0ad756b7ac60'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:04.271150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a04619aa024d2f9f3687abe4228370', 'request_id': 'req-109bc188-f0e6-48a9-bd74-0ad756b7ac60'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:04.287057 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] The token cache is being invalidate because project 67a04619aa024d2f9f3687abe4228370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:04.287395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:04.288087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-109bc188-f0e6-48a9-bd74-0ad756b7ac60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:04.292685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1139/2289] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:04 2022] DELETE /identity/v3/projects/67a04619aa024d2f9f3687abe4228370 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:04.294768 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a05ab-3132-4a31-8871-ef55806c5914 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.295299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a05ab-3132-4a31-8871-ef55806c5914 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.295382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a05ab-3132-4a31-8871-ef55806c5914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.320352 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-193a05ab-3132-4a31-8871-ef55806c5914 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:04.321636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-193a05ab-3132-4a31-8871-ef55806c5914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:04.330038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:04.411997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1151/2290] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:04.421105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9462-6d6f-409f-8fe8-07d650a2ca12 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.421695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9462-6d6f-409f-8fe8-07d650a2ca12 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.422028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9462-6d6f-409f-8fe8-07d650a2ca12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.445652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7ecb9462-6d6f-409f-8fe8-07d650a2ca12 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:04.448160 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7ecb9462-6d6f-409f-8fe8-07d650a2ca12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:04.456934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1140/2291] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:04.461959 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a05ab-3132-4a31-8871-ef55806c5914 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:04.472396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a05ab-3132-4a31-8871-ef55806c5914 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:04.479244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2469b-8313-4525-a279-48450290c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:04.479971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2469b-8313-4525-a279-48450290c59b admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.480261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2469b-8313-4525-a279-48450290c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.484739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2469b-8313-4525-a279-48450290c59b admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.485582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2469b-8313-4525-a279-48450290c59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:15:04.485873 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2469b-8313-4525-a279-48450290c59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:04.487554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2469b-8313-4525-a279-48450290c59b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:04.501031 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1152/2292] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:15:04.506997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb9462-6d6f-409f-8fe8-07d650a2ca12 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:04.514927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:04.523918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb9462-6d6f-409f-8fe8-07d650a2ca12 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:04.532376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cfed7-58b2-424f-98ff-9a09dbeb4394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:04.533835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cfed7-58b2-424f-98ff-9a09dbeb4394 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.533835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cfed7-58b2-424f-98ff-9a09dbeb4394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.534010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cfed7-58b2-424f-98ff-9a09dbeb4394 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.534684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cfed7-58b2-424f-98ff-9a09dbeb4394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:04.537461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cfed7-58b2-424f-98ff-9a09dbeb4394 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:04.575153 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1141/2293] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:04 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:04.578841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2469b-8313-4525-a279-48450290c59b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:04.590115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2469b-8313-4525-a279-48450290c59b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:04.702856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97cc62-8adb-4067-9837-8b3b55070250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:04.704048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97cc62-8adb-4067-9837-8b3b55070250 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.704522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97cc62-8adb-4067-9837-8b3b55070250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.704766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97cc62-8adb-4067-9837-8b3b55070250 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.705571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97cc62-8adb-4067-9837-8b3b55070250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:04.709059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97cc62-8adb-4067-9837-8b3b55070250 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:04.758503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1153/2294] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:04 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:15:04.763224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cfed7-58b2-424f-98ff-9a09dbeb4394 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:04.783617 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cfed7-58b2-424f-98ff-9a09dbeb4394 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:04.791365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882dce7-6e3a-48e8-bb12-db7531681404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:04.791365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882dce7-6e3a-48e8-bb12-db7531681404 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.792100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882dce7-6e3a-48e8-bb12-db7531681404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.792375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882dce7-6e3a-48e8-bb12-db7531681404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.793292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882dce7-6e3a-48e8-bb12-db7531681404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:04.794968 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882dce7-6e3a-48e8-bb12-db7531681404 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:04.808282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1142/2295] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:04.812259 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97cc62-8adb-4067-9837-8b3b55070250 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:04.823430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97cc62-8adb-4067-9837-8b3b55070250 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:04.828062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f244786-d2a5-415e-829f-e45d5e6b2a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:04.828785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244786-d2a5-415e-829f-e45d5e6b2a58 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.829121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244786-d2a5-415e-829f-e45d5e6b2a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.829403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244786-d2a5-415e-829f-e45d5e6b2a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.830132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f244786-d2a5-415e-829f-e45d5e6b2a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:04.831744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f244786-d2a5-415e-829f-e45d5e6b2a58 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:04.842799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1154/2296] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:04.846911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882dce7-6e3a-48e8-bb12-db7531681404 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:04.857371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882dce7-6e3a-48e8-bb12-db7531681404 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:04.862100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0bada-60f5-4c61-a7a6-2a819d09233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:04.862987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0bada-60f5-4c61-a7a6-2a819d09233f admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.863272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0bada-60f5-4c61-a7a6-2a819d09233f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.864081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0bada-60f5-4c61-a7a6-2a819d09233f admin admin] PATH_INFO: `/v3/projects/c45ec98e39ed4cf9816a0fa1f2e21d54/users/05e1e7cf34ec48c686a502a7f3980116/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.880934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0bada-60f5-4c61-a7a6-2a819d09233f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45ec98e39ed4cf9816a0fa1f2e21d54, user_id=05e1e7cf34ec48c686a502a7f3980116, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:04.883648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0bada-60f5-4c61-a7a6-2a819d09233f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:04.897230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1143/2297] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:04 2022] PUT /identity/v3/projects/c45ec98e39ed4cf9816a0fa1f2e21d54/users/05e1e7cf34ec48c686a502a7f3980116/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:04.907675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79c746-8c3c-4227-ae7d-6409fcf931ea None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.907969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79c746-8c3c-4227-ae7d-6409fcf931ea None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.908254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79c746-8c3c-4227-ae7d-6409fcf931ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.943202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5e79c746-8c3c-4227-ae7d-6409fcf931ea None None] MFA Rules not processed for user `05e1e7cf34ec48c686a502a7f3980116`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:04.944340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5e79c746-8c3c-4227-ae7d-6409fcf931ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:05.016710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1155/2298] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:05.022345 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0bada-60f5-4c61-a7a6-2a819d09233f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.089395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0bada-60f5-4c61-a7a6-2a819d09233f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.094479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdede1ce-ca72-4f83-9b04-ae8a4f67aa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.095152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdede1ce-ca72-4f83-9b04-ae8a4f67aa95 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.095743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdede1ce-ca72-4f83-9b04-ae8a4f67aa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.096030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdede1ce-ca72-4f83-9b04-ae8a4f67aa95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.096759 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdede1ce-ca72-4f83-9b04-ae8a4f67aa95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.098947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdede1ce-ca72-4f83-9b04-ae8a4f67aa95 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.130529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1144/2299] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:05 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:15:05.134942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79c746-8c3c-4227-ae7d-6409fcf931ea None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.145730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79c746-8c3c-4227-ae7d-6409fcf931ea None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.149291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:05.211428 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808c43-ce81-405e-9292-e5b2bacade91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.212387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808c43-ce81-405e-9292-e5b2bacade91 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.212720 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808c43-ce81-405e-9292-e5b2bacade91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.213007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808c43-ce81-405e-9292-e5b2bacade91 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.213777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f808c43-ce81-405e-9292-e5b2bacade91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.215753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f808c43-ce81-405e-9292-e5b2bacade91 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.244585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1156/2300] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:05 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:05.249009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdede1ce-ca72-4f83-9b04-ae8a4f67aa95 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.260172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdede1ce-ca72-4f83-9b04-ae8a4f67aa95 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.266791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26191888-4e48-4086-966c-cd1b07851a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.267588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26191888-4e48-4086-966c-cd1b07851a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.267925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26191888-4e48-4086-966c-cd1b07851a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.268296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26191888-4e48-4086-966c-cd1b07851a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.269163 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26191888-4e48-4086-966c-cd1b07851a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.271227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26191888-4e48-4086-966c-cd1b07851a26 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.283209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1145/2301] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:05.288355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808c43-ce81-405e-9292-e5b2bacade91 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.298683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808c43-ce81-405e-9292-e5b2bacade91 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.304469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930efc4-635d-4154-93cd-6ef4ea05162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.305178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930efc4-635d-4154-93cd-6ef4ea05162e admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.305462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930efc4-635d-4154-93cd-6ef4ea05162e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.305756 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930efc4-635d-4154-93cd-6ef4ea05162e admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.306493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930efc4-635d-4154-93cd-6ef4ea05162e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.308131 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930efc4-635d-4154-93cd-6ef4ea05162e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.318800 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1157/2302] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:05.323132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26191888-4e48-4086-966c-cd1b07851a26 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.333922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26191888-4e48-4086-966c-cd1b07851a26 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.338715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e887e3-b681-4358-9b17-a12de02cb8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.339611 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e887e3-b681-4358-9b17-a12de02cb8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.340028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e887e3-b681-4358-9b17-a12de02cb8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.340442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e887e3-b681-4358-9b17-a12de02cb8f0 admin admin] PATH_INFO: `/v3/projects/1a083dd89e094536adc580c915e8be2f/users/43e5d576bb124ac4902fe17a94c6b57e/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.356796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e887e3-b681-4358-9b17-a12de02cb8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a083dd89e094536adc580c915e8be2f, user_id=43e5d576bb124ac4902fe17a94c6b57e, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.359452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e887e3-b681-4358-9b17-a12de02cb8f0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.373166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1146/2303] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:05 2022] PUT /identity/v3/projects/1a083dd89e094536adc580c915e8be2f/users/43e5d576bb124ac4902fe17a94c6b57e/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:05.383453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae3eab-5ffb-46d3-a25a-09fb834cac9c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.383813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae3eab-5ffb-46d3-a25a-09fb834cac9c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.384142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae3eab-5ffb-46d3-a25a-09fb834cac9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.413821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e7ae3eab-5ffb-46d3-a25a-09fb834cac9c None None] MFA Rules not processed for user `43e5d576bb124ac4902fe17a94c6b57e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:05.415041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e7ae3eab-5ffb-46d3-a25a-09fb834cac9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:05.482319 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1158/2304] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:05.486385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e887e3-b681-4358-9b17-a12de02cb8f0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.551986 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:05.556336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e887e3-b681-4358-9b17-a12de02cb8f0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.562797 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1ae87-100f-4c68-b3dd-23580cdf2e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.563495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1ae87-100f-4c68-b3dd-23580cdf2e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.563839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1ae87-100f-4c68-b3dd-23580cdf2e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.564096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1ae87-100f-4c68-b3dd-23580cdf2e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.564815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1ae87-100f-4c68-b3dd-23580cdf2e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.566783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1ae87-100f-4c68-b3dd-23580cdf2e5d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.595397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1147/2305] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:05 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:05.600604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae3eab-5ffb-46d3-a25a-09fb834cac9c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.612952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae3eab-5ffb-46d3-a25a-09fb834cac9c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.682461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664d4bd-7ec4-47ff-8c01-cac44653ea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.683194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664d4bd-7ec4-47ff-8c01-cac44653ea54 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.683445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664d4bd-7ec4-47ff-8c01-cac44653ea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.683722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664d4bd-7ec4-47ff-8c01-cac44653ea54 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.684496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664d4bd-7ec4-47ff-8c01-cac44653ea54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.686898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664d4bd-7ec4-47ff-8c01-cac44653ea54 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.714212 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1159/2306] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:05 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:15:05.718573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1ae87-100f-4c68-b3dd-23580cdf2e5d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.731517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1ae87-100f-4c68-b3dd-23580cdf2e5d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.737603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b33d9-5fd7-4654-99a4-9034bb18ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.738206 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b33d9-5fd7-4654-99a4-9034bb18ae01 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.738494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b33d9-5fd7-4654-99a4-9034bb18ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.738802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b33d9-5fd7-4654-99a4-9034bb18ae01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.739640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b33d9-5fd7-4654-99a4-9034bb18ae01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.741289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b33d9-5fd7-4654-99a4-9034bb18ae01 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.751989 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1148/2307] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:05.756298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664d4bd-7ec4-47ff-8c01-cac44653ea54 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.763513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:05.768458 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664d4bd-7ec4-47ff-8c01-cac44653ea54 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.774397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415cc7c-792c-474b-9bfd-3d3a10c10795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.775319 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415cc7c-792c-474b-9bfd-3d3a10c10795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.775740 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415cc7c-792c-474b-9bfd-3d3a10c10795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.776032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415cc7c-792c-474b-9bfd-3d3a10c10795 admin admin] PATH_INFO: `/v3/projects/7a1e253b34f74a0eb6a631c85920226f/users/430f4bd2de614dc8bf2c853ea890a3bd/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.793077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415cc7c-792c-474b-9bfd-3d3a10c10795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1e253b34f74a0eb6a631c85920226f, user_id=430f4bd2de614dc8bf2c853ea890a3bd, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.795928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415cc7c-792c-474b-9bfd-3d3a10c10795 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.819523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1160/2308] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:05 2022] PUT /identity/v3/projects/7a1e253b34f74a0eb6a631c85920226f/users/430f4bd2de614dc8bf2c853ea890a3bd/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:05.823504 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b33d9-5fd7-4654-99a4-9034bb18ae01 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.834443 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b33d9-5fd7-4654-99a4-9034bb18ae01 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.893783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e97d7-3fa0-4911-8aa6-e90c7b00257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.894462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e97d7-3fa0-4911-8aa6-e90c7b00257a admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.895256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e97d7-3fa0-4911-8aa6-e90c7b00257a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.895685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e97d7-3fa0-4911-8aa6-e90c7b00257a admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.897091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e97d7-3fa0-4911-8aa6-e90c7b00257a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.898740 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e97d7-3fa0-4911-8aa6-e90c7b00257a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.912649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1149/2309] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:05.913853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415cc7c-792c-474b-9bfd-3d3a10c10795 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:05.925427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415cc7c-792c-474b-9bfd-3d3a10c10795 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:05.930935 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39666f-115b-4b23-b3b3-149ee4ea105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:05.931839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39666f-115b-4b23-b3b3-149ee4ea105b admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.932217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39666f-115b-4b23-b3b3-149ee4ea105b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.932437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39666f-115b-4b23-b3b3-149ee4ea105b admin admin] PATH_INFO: `/v3/projects/7a1e253b34f74a0eb6a631c85920226f/users/430f4bd2de614dc8bf2c853ea890a3bd/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:05.934627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39666f-115b-4b23-b3b3-149ee4ea105b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1e253b34f74a0eb6a631c85920226f, user_id=430f4bd2de614dc8bf2c853ea890a3bd, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:05.937436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39666f-115b-4b23-b3b3-149ee4ea105b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:05.949743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1161/2310] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:05 2022] PUT /identity/v3/projects/7a1e253b34f74a0eb6a631c85920226f/users/430f4bd2de614dc8bf2c853ea890a3bd/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:05.961240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947a770-b987-4790-9bea-1a436b278cd6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:05.961538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947a770-b987-4790-9bea-1a436b278cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:05.961825 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947a770-b987-4790-9bea-1a436b278cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:06.002928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4947a770-b987-4790-9bea-1a436b278cd6 None None] MFA Rules not processed for user `430f4bd2de614dc8bf2c853ea890a3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:06.004139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4947a770-b987-4790-9bea-1a436b278cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:06.089938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1150/2311] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:06.101311 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39666f-115b-4b23-b3b3-149ee4ea105b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:06.103076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2d39666f-115b-4b23-b3b3-149ee4ea105b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:06.179155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39666f-115b-4b23-b3b3-149ee4ea105b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:06.182924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ec93-370f-4d1b-b00a-282745d57787 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:06.183580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ec93-370f-4d1b-b00a-282745d57787 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:06.183870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ec93-370f-4d1b-b00a-282745d57787 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:06.184152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ec93-370f-4d1b-b00a-282745d57787 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:06.243868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ec93-370f-4d1b-b00a-282745d57787 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:06.245369 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ec93-370f-4d1b-b00a-282745d57787 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:06.255509 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1162/2312] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:08.876022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947a770-b987-4790-9bea-1a436b278cd6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:08.877716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4947a770-b987-4790-9bea-1a436b278cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:08.892474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947a770-b987-4790-9bea-1a436b278cd6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:08.897555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b75267-155e-4231-b539-ffa477f14244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:08.898296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b75267-155e-4231-b539-ffa477f14244 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:08.898788 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b75267-155e-4231-b539-ffa477f14244 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:08.899058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b75267-155e-4231-b539-ffa477f14244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:08.954653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:08.965968 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b75267-155e-4231-b539-ffa477f14244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:08.967523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b75267-155e-4231-b539-ffa477f14244 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:08.978153 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1151/2313] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:09.575150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ec93-370f-4d1b-b00a-282745d57787 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:09.584249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ec93-370f-4d1b-b00a-282745d57787 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:09.588761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57f5b6-e42d-4a61-82d4-a53874f3afc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:09.589432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57f5b6-e42d-4a61-82d4-a53874f3afc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:09.589757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57f5b6-e42d-4a61-82d4-a53874f3afc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:09.590148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57f5b6-e42d-4a61-82d4-a53874f3afc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:09.602764 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57f5b6-e42d-4a61-82d4-a53874f3afc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:09.604540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57f5b6-e42d-4a61-82d4-a53874f3afc8 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:09.617100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1163/2314] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:13.554649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b75267-155e-4231-b539-ffa477f14244 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:13.618024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b75267-155e-4231-b539-ffa477f14244 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:13.622568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:13.623439 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:13.623725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:13.624001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] PATH_INFO: `/v3/users/05e1e7cf34ec48c686a502a7f3980116` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:13.625223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e1e7cf34ec48c686a502a7f3980116)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:13.627142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:13.674614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e1e7cf34ec48c686a502a7f3980116'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:13.682678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e1e7cf34ec48c686a502a7f3980116'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:13.683318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e1e7cf34ec48c686a502a7f3980116'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:13.683923 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e1e7cf34ec48c686a502a7f3980116'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:13.696922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e1e7cf34ec48c686a502a7f3980116'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:13.711448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1152/2315] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:13 2022] DELETE /identity/v3/users/05e1e7cf34ec48c686a502a7f3980116 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:13.716077 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4806a31-31e3-4d29-a5b0-182c924972f4 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:13.716674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4806a31-31e3-4d29-a5b0-182c924972f4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:13.716674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4806a31-31e3-4d29-a5b0-182c924972f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:13.734902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c4806a31-31e3-4d29-a5b0-182c924972f4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:13.736122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c4806a31-31e3-4d29-a5b0-182c924972f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:13.796208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1164/2316] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:13.806186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:13.807659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:13.875185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f15ed-ec91-40ee-9fe7-96e478a62c81 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:13.880210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02589cfb-599e-41cb-ba15-7a288aa25888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:13.881570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02589cfb-599e-41cb-ba15-7a288aa25888 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:13.882041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02589cfb-599e-41cb-ba15-7a288aa25888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:13.882518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02589cfb-599e-41cb-ba15-7a288aa25888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:13.893884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02589cfb-599e-41cb-ba15-7a288aa25888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:13.895648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02589cfb-599e-41cb-ba15-7a288aa25888 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:13.906974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1153/2317] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:14.228424 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4806a31-31e3-4d29-a5b0-182c924972f4 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:14.230153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c4806a31-31e3-4d29-a5b0-182c924972f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:14.243763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4806a31-31e3-4d29-a5b0-182c924972f4 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:14.248860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:14.249730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:14.250027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:14.250302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] PATH_INFO: `/v3/projects/c45ec98e39ed4cf9816a0fa1f2e21d54` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:14.251548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45ec98e39ed4cf9816a0fa1f2e21d54)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:14.253608 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:14.257408 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:14.312653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45ec98e39ed4cf9816a0fa1f2e21d54', 'request_id': 'req-58d89f97-2baf-4969-ae47-2f0ab6aad153'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.318809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45ec98e39ed4cf9816a0fa1f2e21d54', 'request_id': 'req-58d89f97-2baf-4969-ae47-2f0ab6aad153'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.327505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45ec98e39ed4cf9816a0fa1f2e21d54', 'request_id': 'req-58d89f97-2baf-4969-ae47-2f0ab6aad153'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.339796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] The token cache is being invalidate because project c45ec98e39ed4cf9816a0fa1f2e21d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:14.340208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.340876 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.342490 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1165/2318] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:14 2022] DELETE /identity/v3/projects/c45ec98e39ed4cf9816a0fa1f2e21d54 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:14.346426 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02589cfb-599e-41cb-ba15-7a288aa25888 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:14.357296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02589cfb-599e-41cb-ba15-7a288aa25888 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:14.366814 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:14.421248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd6d4d-ac2d-44a6-ba65-02f9ecc04474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:14.422162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd6d4d-ac2d-44a6-ba65-02f9ecc04474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:14.422537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd6d4d-ac2d-44a6-ba65-02f9ecc04474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:14.422713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd6d4d-ac2d-44a6-ba65-02f9ecc04474 admin admin] PATH_INFO: `/v3/users/43e5d576bb124ac4902fe17a94c6b57e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:14.424020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd6d4d-ac2d-44a6-ba65-02f9ecc04474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e5d576bb124ac4902fe17a94c6b57e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:14.428945 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd6d4d-ac2d-44a6-ba65-02f9ecc04474 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:14.463188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:14.465105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:14.479106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d89f97-2baf-4969-ae47-2f0ab6aad153 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:14.483924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:14.484872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:14.485163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:14.485444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] PATH_INFO: `/v3/users/86c73edacaa14a54a0ae954ba209dddc` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:14.487523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c73edacaa14a54a0ae954ba209dddc)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:14.487926 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f6fd6d4d-ac2d-44a6-ba65-02f9ecc04474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e5d576bb124ac4902fe17a94c6b57e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.490172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:14.496729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f6fd6d4d-ac2d-44a6-ba65-02f9ecc04474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e5d576bb124ac4902fe17a94c6b57e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.497352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f6fd6d4d-ac2d-44a6-ba65-02f9ecc04474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e5d576bb124ac4902fe17a94c6b57e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.497966 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f6fd6d4d-ac2d-44a6-ba65-02f9ecc04474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e5d576bb124ac4902fe17a94c6b57e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.512842 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f6fd6d4d-ac2d-44a6-ba65-02f9ecc04474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e5d576bb124ac4902fe17a94c6b57e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.526533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1154/2319] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:14 2022] DELETE /identity/v3/users/43e5d576bb124ac4902fe17a94c6b57e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:14.543189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c73edacaa14a54a0ae954ba209dddc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.550247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c73edacaa14a54a0ae954ba209dddc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.551520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c73edacaa14a54a0ae954ba209dddc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.552192 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c73edacaa14a54a0ae954ba209dddc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.567930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c73edacaa14a54a0ae954ba209dddc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.582843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1166/2320] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:14 2022] DELETE /identity/v3/users/86c73edacaa14a54a0ae954ba209dddc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:15:14.587679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d079-9ba2-4a27-a672-ca3a06eeb26a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:14.588564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d079-9ba2-4a27-a672-ca3a06eeb26a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:14.589085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d079-9ba2-4a27-a672-ca3a06eeb26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:14.612346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-48f2d079-9ba2-4a27-a672-ca3a06eeb26a None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:14.613819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-48f2d079-9ba2-4a27-a672-ca3a06eeb26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:14.685544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1155/2321] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:14.696089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:14.697721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:14.761099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a9227-d1d3-427c-a13e-e102236c72d5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:14.764943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bf499-b089-4ffa-81a2-722f931ecdbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:14.765598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bf499-b089-4ffa-81a2-722f931ecdbf service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:14.765888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bf499-b089-4ffa-81a2-722f931ecdbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:14.766172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bf499-b089-4ffa-81a2-722f931ecdbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:14.776341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bf499-b089-4ffa-81a2-722f931ecdbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:14.777846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bf499-b089-4ffa-81a2-722f931ecdbf service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:14.789186 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1167/2322] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:14.821833 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d079-9ba2-4a27-a672-ca3a06eeb26a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:14.824129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-48f2d079-9ba2-4a27-a672-ca3a06eeb26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:14.838564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d079-9ba2-4a27-a672-ca3a06eeb26a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:14.844400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:14.845588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:14.845938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:14.846306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] PATH_INFO: `/v3/projects/1a083dd89e094536adc580c915e8be2f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:14.847600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a083dd89e094536adc580c915e8be2f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:14.850290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:14.886234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:14.907832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a083dd89e094536adc580c915e8be2f', 'request_id': 'req-05282bd9-c915-4f30-8e2b-450d2117ec15'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.915959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a083dd89e094536adc580c915e8be2f', 'request_id': 'req-05282bd9-c915-4f30-8e2b-450d2117ec15'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.922030 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a083dd89e094536adc580c915e8be2f', 'request_id': 'req-05282bd9-c915-4f30-8e2b-450d2117ec15'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.935051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] The token cache is being invalidate because project 1a083dd89e094536adc580c915e8be2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:14.935618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.936557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:14.938245 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1156/2323] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:14 2022] DELETE /identity/v3/projects/1a083dd89e094536adc580c915e8be2f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:14.944926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bf499-b089-4ffa-81a2-722f931ecdbf service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:14.955436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bf499-b089-4ffa-81a2-722f931ecdbf service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:14.961075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:15.055422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179520d-f16c-493b-b6aa-ee3bd03b9d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:15.056326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179520d-f16c-493b-b6aa-ee3bd03b9d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.056923 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179520d-f16c-493b-b6aa-ee3bd03b9d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.057216 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179520d-f16c-493b-b6aa-ee3bd03b9d9f admin admin] PATH_INFO: `/v3/users/430f4bd2de614dc8bf2c853ea890a3bd` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.060075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179520d-f16c-493b-b6aa-ee3bd03b9d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=430f4bd2de614dc8bf2c853ea890a3bd)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:15.062236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179520d-f16c-493b-b6aa-ee3bd03b9d9f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:15.112102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:15.114351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:15.151547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05282bd9-c915-4f30-8e2b-450d2117ec15 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:15.160600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:15.162186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.162710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.162851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] PATH_INFO: `/v3/projects/5f427d7e2ab74fd6bdfd34d06ede35cb` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.166608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f427d7e2ab74fd6bdfd34d06ede35cb)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:15.166608 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:15.169163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e179520d-f16c-493b-b6aa-ee3bd03b9d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '430f4bd2de614dc8bf2c853ea890a3bd'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.181017 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e179520d-f16c-493b-b6aa-ee3bd03b9d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '430f4bd2de614dc8bf2c853ea890a3bd'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.182126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e179520d-f16c-493b-b6aa-ee3bd03b9d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '430f4bd2de614dc8bf2c853ea890a3bd'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.183065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e179520d-f16c-493b-b6aa-ee3bd03b9d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '430f4bd2de614dc8bf2c853ea890a3bd'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.212299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-e179520d-f16c-493b-b6aa-ee3bd03b9d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '430f4bd2de614dc8bf2c853ea890a3bd'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.236875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1168/2324] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:14 2022] DELETE /identity/v3/users/430f4bd2de614dc8bf2c853ea890a3bd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:15.257327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f427d7e2ab74fd6bdfd34d06ede35cb', 'request_id': 'req-ed3ff79c-2914-44f0-8e3e-09895554f416'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.264937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f427d7e2ab74fd6bdfd34d06ede35cb', 'request_id': 'req-ed3ff79c-2914-44f0-8e3e-09895554f416'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.273302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f427d7e2ab74fd6bdfd34d06ede35cb', 'request_id': 'req-ed3ff79c-2914-44f0-8e3e-09895554f416'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.294640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] The token cache is being invalidate because project 5f427d7e2ab74fd6bdfd34d06ede35cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:15.294960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.295613 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ed3ff79c-2914-44f0-8e3e-09895554f416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.297667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1157/2325] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:15 2022] DELETE /identity/v3/projects/5f427d7e2ab74fd6bdfd34d06ede35cb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:15.303497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89abb5-8350-426f-bb59-0766aac90176 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.303803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89abb5-8350-426f-bb59-0766aac90176 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.304214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89abb5-8350-426f-bb59-0766aac90176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.328307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-2a89abb5-8350-426f-bb59-0766aac90176 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:15.329594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2a89abb5-8350-426f-bb59-0766aac90176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:15.409395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1169/2326] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:15.418203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8541d-f1ac-4cfb-95a6-1866c82f7a04 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.418482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8541d-f1ac-4cfb-95a6-1866c82f7a04 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.418773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8541d-f1ac-4cfb-95a6-1866c82f7a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.443483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1ef8541d-f1ac-4cfb-95a6-1866c82f7a04 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:15.444763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1ef8541d-f1ac-4cfb-95a6-1866c82f7a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:15.454157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1158/2327] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:15.458454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89abb5-8350-426f-bb59-0766aac90176 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:15.471466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89abb5-8350-426f-bb59-0766aac90176 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:15.476856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19f992-b1f4-4ffa-a1df-ba2d0b6b1fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:15.477537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19f992-b1f4-4ffa-a1df-ba2d0b6b1fea admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.477824 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19f992-b1f4-4ffa-a1df-ba2d0b6b1fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.478105 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19f992-b1f4-4ffa-a1df-ba2d0b6b1fea admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.478846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19f992-b1f4-4ffa-a1df-ba2d0b6b1fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:15:15.479345 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19f992-b1f4-4ffa-a1df-ba2d0b6b1fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:15.481117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19f992-b1f4-4ffa-a1df-ba2d0b6b1fea admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:15.493860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1170/2328] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:15:15.498089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8541d-f1ac-4cfb-95a6-1866c82f7a04 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:15.508934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8541d-f1ac-4cfb-95a6-1866c82f7a04 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:15.516632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b7a7b-5d65-4ea8-aca8-c963bdb366c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:15.517319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7a7b-5d65-4ea8-aca8-c963bdb366c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.518805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7a7b-5d65-4ea8-aca8-c963bdb366c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.518805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7a7b-5d65-4ea8-aca8-c963bdb366c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.518805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b7a7b-5d65-4ea8-aca8-c963bdb366c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:15.521434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b7a7b-5d65-4ea8-aca8-c963bdb366c3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:15.550050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1159/2329] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:15 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:15.554932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19f992-b1f4-4ffa-a1df-ba2d0b6b1fea admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:15.568391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19f992-b1f4-4ffa-a1df-ba2d0b6b1fea admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:15.578210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:15.589063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b7a7b-5d65-4ea8-aca8-c963bdb366c3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:15.591263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8a7b7a7b-5d65-4ea8-aca8-c963bdb366c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:15.637594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291714f-5ff4-4e02-a75f-4e5b88e13d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:15.638256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291714f-5ff4-4e02-a75f-4e5b88e13d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.638525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291714f-5ff4-4e02-a75f-4e5b88e13d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.638803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291714f-5ff4-4e02-a75f-4e5b88e13d59 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.639514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291714f-5ff4-4e02-a75f-4e5b88e13d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:15.642207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291714f-5ff4-4e02-a75f-4e5b88e13d59 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:15.664345 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1171/2330] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:15 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:15.668341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291714f-5ff4-4e02-a75f-4e5b88e13d59 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:15.680201 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291714f-5ff4-4e02-a75f-4e5b88e13d59 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:15.685719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a68a-c266-4531-94d9-222122524e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:15.686501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a68a-c266-4531-94d9-222122524e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.686809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a68a-c266-4531-94d9-222122524e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.687098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a68a-c266-4531-94d9-222122524e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.687380 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b7a7b-5d65-4ea8-aca8-c963bdb366c3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:15.687865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a68a-c266-4531-94d9-222122524e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:15.689534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a68a-c266-4531-94d9-222122524e30 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:15.693962 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:15.694844 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.695146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.695405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] PATH_INFO: `/v3/projects/7a1e253b34f74a0eb6a631c85920226f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.696594 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1e253b34f74a0eb6a631c85920226f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:15.698726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:15.702444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1172/2331] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:15:15.706409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a68a-c266-4531-94d9-222122524e30 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:15.714615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:15.717301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a68a-c266-4531-94d9-222122524e30 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:15.722342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8e2a7-b2b0-48b0-aa6d-1ead89ccd753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:15.723560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8e2a7-b2b0-48b0-aa6d-1ead89ccd753 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.723850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8e2a7-b2b0-48b0-aa6d-1ead89ccd753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.724132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8e2a7-b2b0-48b0-aa6d-1ead89ccd753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.724898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8e2a7-b2b0-48b0-aa6d-1ead89ccd753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:15.726523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8e2a7-b2b0-48b0-aa6d-1ead89ccd753 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:15.737500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1173/2332] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:15:15.742929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8e2a7-b2b0-48b0-aa6d-1ead89ccd753 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:15.752850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8e2a7-b2b0-48b0-aa6d-1ead89ccd753 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:15.761292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1e253b34f74a0eb6a631c85920226f', 'request_id': 'req-0a465b27-645d-4318-9337-d4c81eaaed71'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.773482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1e253b34f74a0eb6a631c85920226f', 'request_id': 'req-0a465b27-645d-4318-9337-d4c81eaaed71'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.779605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1e253b34f74a0eb6a631c85920226f', 'request_id': 'req-0a465b27-645d-4318-9337-d4c81eaaed71'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.793640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] The token cache is being invalidate because project 7a1e253b34f74a0eb6a631c85920226f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:15.793940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.794633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0a465b27-645d-4318-9337-d4c81eaaed71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:15.796203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1160/2333] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:15 2022] DELETE /identity/v3/projects/7a1e253b34f74a0eb6a631c85920226f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:15.801739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2812-62f1-476f-9259-33a48bdc7634 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.802024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2812-62f1-476f-9259-33a48bdc7634 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.802307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2812-62f1-476f-9259-33a48bdc7634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.814310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc94a34-b27f-4b39-9822-4b18753fc7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:15.815269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc94a34-b27f-4b39-9822-4b18753fc7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.815556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc94a34-b27f-4b39-9822-4b18753fc7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.815828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc94a34-b27f-4b39-9822-4b18753fc7fa admin admin] PATH_INFO: `/v3/projects/85f827b080014a94a7192baac162ea99/users/03af69d398aa4dbda66c6295dffe0371/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.821248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2a9d2812-62f1-476f-9259-33a48bdc7634 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:15.822456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2a9d2812-62f1-476f-9259-33a48bdc7634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:15.830783 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1161/2334] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:15.831168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc94a34-b27f-4b39-9822-4b18753fc7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f827b080014a94a7192baac162ea99, user_id=03af69d398aa4dbda66c6295dffe0371, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:15.834201 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc94a34-b27f-4b39-9822-4b18753fc7fa admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:15.838535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe47ef-8869-45d5-bafb-cfe1b62a01b7 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.838830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe47ef-8869-45d5-bafb-cfe1b62a01b7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.839125 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe47ef-8869-45d5-bafb-cfe1b62a01b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.847029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1174/2335] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:15 2022] PUT /identity/v3/projects/85f827b080014a94a7192baac162ea99/users/03af69d398aa4dbda66c6295dffe0371/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:15:15.857732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-18fe47ef-8869-45d5-bafb-cfe1b62a01b7 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:15.858581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0cbab-5b33-4392-a40d-755f6cc3af05 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.859011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-18fe47ef-8869-45d5-bafb-cfe1b62a01b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:15.859123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0cbab-5b33-4392-a40d-755f6cc3af05 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.859402 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0cbab-5b33-4392-a40d-755f6cc3af05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.888387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-03a0cbab-5b33-4392-a40d-755f6cc3af05 None None] MFA Rules not processed for user `03af69d398aa4dbda66c6295dffe0371`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:15.889542 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-03a0cbab-5b33-4392-a40d-755f6cc3af05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:15.924456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1162/2336] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:15.929404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe47ef-8869-45d5-bafb-cfe1b62a01b7 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:15.938225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe47ef-8869-45d5-bafb-cfe1b62a01b7 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:15.943448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d83e6c-5ed9-4cb7-9dba-734d36bf268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:15.944100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d83e6c-5ed9-4cb7-9dba-734d36bf268d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.944387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d83e6c-5ed9-4cb7-9dba-734d36bf268d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.944697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d83e6c-5ed9-4cb7-9dba-734d36bf268d admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.945457 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d83e6c-5ed9-4cb7-9dba-734d36bf268d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:15:15.945768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d83e6c-5ed9-4cb7-9dba-734d36bf268d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:15.947076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:15.947368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d83e6c-5ed9-4cb7-9dba-734d36bf268d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:15.958744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1175/2337] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:15.963238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1163/2338] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:15:15.969199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0cbab-5b33-4392-a40d-755f6cc3af05 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:15.969657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d83e6c-5ed9-4cb7-9dba-734d36bf268d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:15.971358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-26d83e6c-5ed9-4cb7-9dba-734d36bf268d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:15.980932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0cbab-5b33-4392-a40d-755f6cc3af05 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:15.985692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3557d1-2d8e-4da4-98d9-7c1980e182aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:15.986355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3557d1-2d8e-4da4-98d9-7c1980e182aa admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:15.986643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3557d1-2d8e-4da4-98d9-7c1980e182aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:15.986922 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3557d1-2d8e-4da4-98d9-7c1980e182aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:15.987621 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3557d1-2d8e-4da4-98d9-7c1980e182aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:15.990379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3557d1-2d8e-4da4-98d9-7c1980e182aa admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:16.018892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1176/2339] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:15 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:16.023003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3557d1-2d8e-4da4-98d9-7c1980e182aa admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:16.034921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d83e6c-5ed9-4cb7-9dba-734d36bf268d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:16.073716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:16.093638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a13128-4075-48e7-8db4-a9f35b121a9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:16.094780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a13128-4075-48e7-8db4-a9f35b121a9b service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:16.095066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a13128-4075-48e7-8db4-a9f35b121a9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:16.095378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a13128-4075-48e7-8db4-a9f35b121a9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:16.101668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3557d1-2d8e-4da4-98d9-7c1980e182aa admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:16.106562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3ae5a-08d8-4683-b08f-842e9dabf911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:16.107240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3ae5a-08d8-4683-b08f-842e9dabf911 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:16.107540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3ae5a-08d8-4683-b08f-842e9dabf911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:16.107807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3ae5a-08d8-4683-b08f-842e9dabf911 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:16.108504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3ae5a-08d8-4683-b08f-842e9dabf911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:16.110610 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3ae5a-08d8-4683-b08f-842e9dabf911 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:16.132605 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1177/2340] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:16 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:15:16.137026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3ae5a-08d8-4683-b08f-842e9dabf911 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:16.147602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3ae5a-08d8-4683-b08f-842e9dabf911 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:16.152406 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f443f4-59c9-457b-b42f-bdd3cfd51677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:16.153098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f443f4-59c9-457b-b42f-bdd3cfd51677 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:16.153383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f443f4-59c9-457b-b42f-bdd3cfd51677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:16.153689 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f443f4-59c9-457b-b42f-bdd3cfd51677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:16.154424 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f443f4-59c9-457b-b42f-bdd3cfd51677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:16.156057 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f443f4-59c9-457b-b42f-bdd3cfd51677 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:16.170873 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1178/2341] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:16.171952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f443f4-59c9-457b-b42f-bdd3cfd51677 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:16.179697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a13128-4075-48e7-8db4-a9f35b121a9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:16.181203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a13128-4075-48e7-8db4-a9f35b121a9b service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:16.182409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f443f4-59c9-457b-b42f-bdd3cfd51677 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:16.187267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cb0e0-978d-48ff-9eba-1f9e9fe1f468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:16.187958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cb0e0-978d-48ff-9eba-1f9e9fe1f468 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:16.188242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cb0e0-978d-48ff-9eba-1f9e9fe1f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:16.188519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cb0e0-978d-48ff-9eba-1f9e9fe1f468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:16.189300 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cb0e0-978d-48ff-9eba-1f9e9fe1f468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:16.190079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1164/2342] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:15:16.192965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cb0e0-978d-48ff-9eba-1f9e9fe1f468 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:16.210275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1179/2343] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:15:16.210451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a13128-4075-48e7-8db4-a9f35b121a9b service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:16.220683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a13128-4075-48e7-8db4-a9f35b121a9b service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:16.226301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4ae61-9c84-4947-ac12-b150322ac64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:16.227191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4ae61-9c84-4947-ac12-b150322ac64e admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:16.227477 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4ae61-9c84-4947-ac12-b150322ac64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:16.227760 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4ae61-9c84-4947-ac12-b150322ac64e admin admin] PATH_INFO: `/v3/projects/608837ccca4d4c34a32702e95a25aba0/users/6734724f68514b3190569f02e3d08ddb/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:16.244489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4ae61-9c84-4947-ac12-b150322ac64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=608837ccca4d4c34a32702e95a25aba0, user_id=6734724f68514b3190569f02e3d08ddb, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:16.247498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4ae61-9c84-4947-ac12-b150322ac64e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:16.261514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1165/2344] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:16 2022] PUT /identity/v3/projects/608837ccca4d4c34a32702e95a25aba0/users/6734724f68514b3190569f02e3d08ddb/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:15:16.266921 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c360b4d-cc2d-4914-b6ee-2779bae1dfcc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:16.267779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c360b4d-cc2d-4914-b6ee-2779bae1dfcc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:16.268106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c360b4d-cc2d-4914-b6ee-2779bae1dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:16.286654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-9c360b4d-cc2d-4914-b6ee-2779bae1dfcc None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:16.287981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9c360b4d-cc2d-4914-b6ee-2779bae1dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:16.364965 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1180/2345] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:16.378083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4ae61-9c84-4947-ac12-b150322ac64e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:16.381500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8dd4ae61-9c84-4947-ac12-b150322ac64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:16.469149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4ae61-9c84-4947-ac12-b150322ac64e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:16.475373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a8a5e-9a90-4c40-8106-325416ba44d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:16.476079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8a5e-9a90-4c40-8106-325416ba44d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:16.476392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8a5e-9a90-4c40-8106-325416ba44d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:16.476955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8a5e-9a90-4c40-8106-325416ba44d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:16.503490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a8a5e-9a90-4c40-8106-325416ba44d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:16.506533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a8a5e-9a90-4c40-8106-325416ba44d0 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:16.534306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1166/2346] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:19.658916 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c360b4d-cc2d-4914-b6ee-2779bae1dfcc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:19.662083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9c360b4d-cc2d-4914-b6ee-2779bae1dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:19.678803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c360b4d-cc2d-4914-b6ee-2779bae1dfcc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:19.684170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:19.685276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.685501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.685981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] PATH_INFO: `/v3/users/03af69d398aa4dbda66c6295dffe0371` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.687352 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03af69d398aa4dbda66c6295dffe0371)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:19.690407 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:19.737567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:19.752990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03af69d398aa4dbda66c6295dffe0371'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:19.762756 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03af69d398aa4dbda66c6295dffe0371'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:19.763668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03af69d398aa4dbda66c6295dffe0371'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:19.764377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03af69d398aa4dbda66c6295dffe0371'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:19.783462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03af69d398aa4dbda66c6295dffe0371'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:19.812547 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1181/2347] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:19 2022] DELETE /identity/v3/users/03af69d398aa4dbda66c6295dffe0371 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:15:19.813069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36895d-48b5-42d5-b14f-c69fdb3d5de0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.813540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36895d-48b5-42d5-b14f-c69fdb3d5de0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.813791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36895d-48b5-42d5-b14f-c69fdb3d5de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.835907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9a36895d-48b5-42d5-b14f-c69fdb3d5de0 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:19.837545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9a36895d-48b5-42d5-b14f-c69fdb3d5de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:19.943353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1167/2348] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:19.956393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:19.959325 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:20.042204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eda142-354a-456a-b97a-018dfeafb099 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:20.047815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5a04e-1976-40d0-87c7-4df0a0de4e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:20.048910 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5a04e-1976-40d0-87c7-4df0a0de4e11 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:20.049417 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5a04e-1976-40d0-87c7-4df0a0de4e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:20.049927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5a04e-1976-40d0-87c7-4df0a0de4e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:20.071801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5a04e-1976-40d0-87c7-4df0a0de4e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:20.075543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5a04e-1976-40d0-87c7-4df0a0de4e11 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:20.087277 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1182/2349] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:20.580247 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36895d-48b5-42d5-b14f-c69fdb3d5de0 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:20.581807 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9a36895d-48b5-42d5-b14f-c69fdb3d5de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:20.597340 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36895d-48b5-42d5-b14f-c69fdb3d5de0 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:20.603566 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:20.604392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:20.604768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:20.605055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] PATH_INFO: `/v3/projects/85f827b080014a94a7192baac162ea99` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:20.606499 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f827b080014a94a7192baac162ea99)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:20.608508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:20.619453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:20.696023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f827b080014a94a7192baac162ea99', 'request_id': 'req-049b1d57-c32c-4b77-ab9a-cd122e1204fe'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:20.705285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f827b080014a94a7192baac162ea99', 'request_id': 'req-049b1d57-c32c-4b77-ab9a-cd122e1204fe'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:20.713044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f827b080014a94a7192baac162ea99', 'request_id': 'req-049b1d57-c32c-4b77-ab9a-cd122e1204fe'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:20.755908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] The token cache is being invalidate because project 85f827b080014a94a7192baac162ea99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:20.756401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:20.757290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-049b1d57-c32c-4b77-ab9a-cd122e1204fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:20.759393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1168/2350] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:20 2022] DELETE /identity/v3/projects/85f827b080014a94a7192baac162ea99 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:20.767208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e357b-7550-49eb-9269-cddd8c0b6791 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:20.768220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e357b-7550-49eb-9269-cddd8c0b6791 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:20.768731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e357b-7550-49eb-9269-cddd8c0b6791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:20.795314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-807e357b-7550-49eb-9269-cddd8c0b6791 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:20.796599 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-807e357b-7550-49eb-9269-cddd8c0b6791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:20.874215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1183/2351] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:20.877766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d648b6e-9b8c-450d-a3b2-1e0362b1db53 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:20.878263 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d648b6e-9b8c-450d-a3b2-1e0362b1db53 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:20.878570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d648b6e-9b8c-450d-a3b2-1e0362b1db53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:20.901589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0d648b6e-9b8c-450d-a3b2-1e0362b1db53 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:20.903728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0d648b6e-9b8c-450d-a3b2-1e0362b1db53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:20.918861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1169/2352] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:20.923606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e357b-7550-49eb-9269-cddd8c0b6791 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:20.937275 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e357b-7550-49eb-9269-cddd8c0b6791 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:20.943679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92731d01-9210-45a7-864b-20d79317d40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:20.944533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731d01-9210-45a7-864b-20d79317d40f admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:20.944859 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731d01-9210-45a7-864b-20d79317d40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:20.945145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731d01-9210-45a7-864b-20d79317d40f admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:20.945925 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92731d01-9210-45a7-864b-20d79317d40f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:15:20.946241 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92731d01-9210-45a7-864b-20d79317d40f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:20.948874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92731d01-9210-45a7-864b-20d79317d40f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:20.963863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1184/2353] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:15:20.968479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d648b6e-9b8c-450d-a3b2-1e0362b1db53 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:20.980445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d648b6e-9b8c-450d-a3b2-1e0362b1db53 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:20.986242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4ece2-89f2-4cbc-a8e7-96cd47745699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:20.986912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4ece2-89f2-4cbc-a8e7-96cd47745699 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:20.987199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4ece2-89f2-4cbc-a8e7-96cd47745699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:20.987482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4ece2-89f2-4cbc-a8e7-96cd47745699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:20.988229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4ece2-89f2-4cbc-a8e7-96cd47745699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:20.990778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4ece2-89f2-4cbc-a8e7-96cd47745699 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:21.024667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1170/2354] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:20 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:21.026786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92731d01-9210-45a7-864b-20d79317d40f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:21.038121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92731d01-9210-45a7-864b-20d79317d40f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:21.092034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:21.116194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0c116-25d0-405b-83de-5364fd51ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:21.117590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0c116-25d0-405b-83de-5364fd51ccd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:21.117983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0c116-25d0-405b-83de-5364fd51ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:21.118341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0c116-25d0-405b-83de-5364fd51ccd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:21.119135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0c116-25d0-405b-83de-5364fd51ccd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:21.121316 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0c116-25d0-405b-83de-5364fd51ccd1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:21.146873 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1185/2355] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:21 2022] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:21.148351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4ece2-89f2-4cbc-a8e7-96cd47745699 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:21.159362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4ece2-89f2-4cbc-a8e7-96cd47745699 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:21.167791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777c929-1664-45f3-aa1c-73e9ee2957d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:21.168493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777c929-1664-45f3-aa1c-73e9ee2957d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:21.168878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777c929-1664-45f3-aa1c-73e9ee2957d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:21.169158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777c929-1664-45f3-aa1c-73e9ee2957d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:21.169912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777c929-1664-45f3-aa1c-73e9ee2957d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:21.171724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777c929-1664-45f3-aa1c-73e9ee2957d4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:21.184692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1171/2356] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:21.189704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0c116-25d0-405b-83de-5364fd51ccd1 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:21.200780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0c116-25d0-405b-83de-5364fd51ccd1 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:21.206663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e40d82-8cc4-443a-a70b-48842c2753a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:21.208001 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40d82-8cc4-443a-a70b-48842c2753a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:21.208120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40d82-8cc4-443a-a70b-48842c2753a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:21.214590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40d82-8cc4-443a-a70b-48842c2753a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:21.215607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e40d82-8cc4-443a-a70b-48842c2753a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:21.217491 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e40d82-8cc4-443a-a70b-48842c2753a2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:21.230251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1186/2357] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:21.234724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777c929-1664-45f3-aa1c-73e9ee2957d4 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:21.247716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777c929-1664-45f3-aa1c-73e9ee2957d4 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:21.254185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc320ef0-285c-4c87-8dd2-ede5dd8290b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:21.255154 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320ef0-285c-4c87-8dd2-ede5dd8290b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:21.255444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320ef0-285c-4c87-8dd2-ede5dd8290b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:21.255725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320ef0-285c-4c87-8dd2-ede5dd8290b8 admin admin] PATH_INFO: `/v3/projects/54e970b0876749858ee74692e2f02e7c/users/e16c919517bb43bfa552e00b9ae1595b/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:21.272868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc320ef0-285c-4c87-8dd2-ede5dd8290b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e970b0876749858ee74692e2f02e7c, user_id=e16c919517bb43bfa552e00b9ae1595b, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:21.275638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc320ef0-285c-4c87-8dd2-ede5dd8290b8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:21.320284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1172/2358] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:21 2022] PUT /identity/v3/projects/54e970b0876749858ee74692e2f02e7c/users/e16c919517bb43bfa552e00b9ae1595b/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:21.334115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbbfcb-70b6-4d06-a3a3-41da67d1f7f4 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:21.334455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbbfcb-70b6-4d06-a3a3-41da67d1f7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:21.334749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbbfcb-70b6-4d06-a3a3-41da67d1f7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:21.379588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b2cbbfcb-70b6-4d06-a3a3-41da67d1f7f4 None None] MFA Rules not processed for user `e16c919517bb43bfa552e00b9ae1595b`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:21.381250 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b2cbbfcb-70b6-4d06-a3a3-41da67d1f7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:21.487383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1187/2359] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:21.495830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc320ef0-285c-4c87-8dd2-ede5dd8290b8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:21.497991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cc320ef0-285c-4c87-8dd2-ede5dd8290b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:21.588056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc320ef0-285c-4c87-8dd2-ede5dd8290b8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:21.592593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86c902-11f7-4719-aafe-f286a905f75f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3780488ee9404b3b8eda52acf8dceca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:21.593837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86c902-11f7-4719-aafe-f286a905f75f service glance] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:21.594337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86c902-11f7-4719-aafe-f286a905f75f service glance] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:21.594698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86c902-11f7-4719-aafe-f286a905f75f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:21.606912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86c902-11f7-4719-aafe-f286a905f75f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:21.608481 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86c902-11f7-4719-aafe-f286a905f75f service glance] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:21.636501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1173/2360] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:21.864253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8778f4f-62c2-4160-8ce5-bccf8ef431ff None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:21.864777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8778f4f-62c2-4160-8ce5-bccf8ef431ff None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:21.864884 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8778f4f-62c2-4160-8ce5-bccf8ef431ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:21.896731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b8778f4f-62c2-4160-8ce5-bccf8ef431ff None None] MFA Rules not processed for user `6734724f68514b3190569f02e3d08ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:21.898076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b8778f4f-62c2-4160-8ce5-bccf8ef431ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:21.979112 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1188/2361] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:21.983594 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86c902-11f7-4719-aafe-f286a905f75f service glance] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:21.985458 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5f86c902-11f7-4719-aafe-f286a905f75f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:22.033715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:22.073893 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86c902-11f7-4719-aafe-f286a905f75f service glance] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:22.079114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ced937-f424-4125-a79d-7912a646d778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:22.079828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced937-f424-4125-a79d-7912a646d778 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.080119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced937-f424-4125-a79d-7912a646d778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.080428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced937-f424-4125-a79d-7912a646d778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.081267 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ced937-f424-4125-a79d-7912a646d778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:22.084405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ced937-f424-4125-a79d-7912a646d778 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:22.127249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1174/2362] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:21 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:22.132469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8778f4f-62c2-4160-8ce5-bccf8ef431ff None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:22.144344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8778f4f-62c2-4160-8ce5-bccf8ef431ff None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:22.196193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:22.219572 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d42bfa-0e0b-4df3-a9f3-f8a1d9b9e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:22.221190 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d42bfa-0e0b-4df3-a9f3-f8a1d9b9e54e admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.221800 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d42bfa-0e0b-4df3-a9f3-f8a1d9b9e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.221800 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d42bfa-0e0b-4df3-a9f3-f8a1d9b9e54e admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.222525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d42bfa-0e0b-4df3-a9f3-f8a1d9b9e54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:22.224913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d42bfa-0e0b-4df3-a9f3-f8a1d9b9e54e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:22.249386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1189/2363] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:22 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:22.254653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ced937-f424-4125-a79d-7912a646d778 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:22.265454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ced937-f424-4125-a79d-7912a646d778 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:22.270531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e04cb-a8f8-491c-9a5e-046daf169e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:22.271312 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e04cb-a8f8-491c-9a5e-046daf169e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.271664 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e04cb-a8f8-491c-9a5e-046daf169e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.272010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e04cb-a8f8-491c-9a5e-046daf169e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.272852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e04cb-a8f8-491c-9a5e-046daf169e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:22.274709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e04cb-a8f8-491c-9a5e-046daf169e6d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:22.286356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1175/2364] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:22.290813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d42bfa-0e0b-4df3-a9f3-f8a1d9b9e54e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:22.301549 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d42bfa-0e0b-4df3-a9f3-f8a1d9b9e54e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:22.306694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852166c-974a-44bd-bacf-0cdc4afa7c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:22.307593 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852166c-974a-44bd-bacf-0cdc4afa7c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.307872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852166c-974a-44bd-bacf-0cdc4afa7c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.308160 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852166c-974a-44bd-bacf-0cdc4afa7c39 admin admin] PATH_INFO: `/v3/projects/024c139199e946c68fa5241b5c978da8/users/fa678395766c4e10ba7d079ae00c1448/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.326983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852166c-974a-44bd-bacf-0cdc4afa7c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024c139199e946c68fa5241b5c978da8, user_id=fa678395766c4e10ba7d079ae00c1448, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:22.330614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852166c-974a-44bd-bacf-0cdc4afa7c39 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:22.344580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1190/2365] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:22 2022] PUT /identity/v3/projects/024c139199e946c68fa5241b5c978da8/users/fa678395766c4e10ba7d079ae00c1448/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:22.350893 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e04cb-a8f8-491c-9a5e-046daf169e6d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:22.370044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e04cb-a8f8-491c-9a5e-046daf169e6d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:22.463714 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aa044-b39e-4e3b-80cb-a35df5c863e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:22.464682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa044-b39e-4e3b-80cb-a35df5c863e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.464985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa044-b39e-4e3b-80cb-a35df5c863e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.465284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa044-b39e-4e3b-80cb-a35df5c863e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.466020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188aa044-b39e-4e3b-80cb-a35df5c863e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:22.467664 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188aa044-b39e-4e3b-80cb-a35df5c863e4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:22.478830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1176/2366] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:22.483129 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852166c-974a-44bd-bacf-0cdc4afa7c39 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:22.503690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852166c-974a-44bd-bacf-0cdc4afa7c39 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:22.518783 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1b39b-0075-47e6-bc4b-43e84a13bc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:22.519840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1b39b-0075-47e6-bc4b-43e84a13bc8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.520477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1b39b-0075-47e6-bc4b-43e84a13bc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.520477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1b39b-0075-47e6-bc4b-43e84a13bc8c admin admin] PATH_INFO: `/v3/projects/024c139199e946c68fa5241b5c978da8/users/fa678395766c4e10ba7d079ae00c1448/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.522684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1b39b-0075-47e6-bc4b-43e84a13bc8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=024c139199e946c68fa5241b5c978da8, user_id=fa678395766c4e10ba7d079ae00c1448, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:22.525483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1b39b-0075-47e6-bc4b-43e84a13bc8c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:22.543338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1191/2367] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:22 2022] PUT /identity/v3/projects/024c139199e946c68fa5241b5c978da8/users/fa678395766c4e10ba7d079ae00c1448/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:26.819412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a501-8e6e-4735-8cfc-bb66b7635a6d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:26.820413 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a501-8e6e-4735-8cfc-bb66b7635a6d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:26.821008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a501-8e6e-4735-8cfc-bb66b7635a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:26.865587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a022a501-8e6e-4735-8cfc-bb66b7635a6d None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:26.867352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a022a501-8e6e-4735-8cfc-bb66b7635a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:26.983737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1177/2368] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:15:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:27.083992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1b39b-0075-47e6-bc4b-43e84a13bc8c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:27.086990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-edc1b39b-0075-47e6-bc4b-43e84a13bc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:27.239876 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1b39b-0075-47e6-bc4b-43e84a13bc8c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:27.266068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4467f-be1e-44ad-8094-8933b6c820fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:27.266850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4467f-be1e-44ad-8094-8933b6c820fa service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:27.267236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4467f-be1e-44ad-8094-8933b6c820fa service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:27.268443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4467f-be1e-44ad-8094-8933b6c820fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:27.289312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4467f-be1e-44ad-8094-8933b6c820fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:27.291257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4467f-be1e-44ad-8094-8933b6c820fa service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:27.304437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1192/2369] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:15:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:15:28.937038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd94a4-bdb8-4b63-a040-c684938584a9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:28.937562 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd94a4-bdb8-4b63-a040-c684938584a9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:28.937662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd94a4-bdb8-4b63-a040-c684938584a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:28.985565 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5dbd94a4-bdb8-4b63-a040-c684938584a9 None None] MFA Rules not processed for user `fa678395766c4e10ba7d079ae00c1448`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:28.987564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5dbd94a4-bdb8-4b63-a040-c684938584a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:29.059829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:29.119817 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1178/2370] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:33.695643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a3ee-707f-405f-acb2-ef6794fc7ef4 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:33.696472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a3ee-707f-405f-acb2-ef6794fc7ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:33.696803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87a3ee-707f-405f-acb2-ef6794fc7ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:33.745096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0b87a3ee-707f-405f-acb2-ef6794fc7ef4 None None] MFA Rules not processed for user `c17483c734a6435ea9599f15cab4a559`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:33.748360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0b87a3ee-707f-405f-acb2-ef6794fc7ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:33.854978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:33.866674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1193/2371] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:37.666143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd94a4-bdb8-4b63-a040-c684938584a9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:37.667839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5dbd94a4-bdb8-4b63-a040-c684938584a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:37.824673 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd94a4-bdb8-4b63-a040-c684938584a9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:37.824929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:37.825789 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:37.826096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:37.826351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] PATH_INFO: `/v3/users/7b1b18cb8a2447caaba2fd3d481c7303` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:37.827658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1b18cb8a2447caaba2fd3d481c7303)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:37.829750 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:37.936561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1b18cb8a2447caaba2fd3d481c7303'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.957337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1b18cb8a2447caaba2fd3d481c7303'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.958571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1b18cb8a2447caaba2fd3d481c7303'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.959697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1b18cb8a2447caaba2fd3d481c7303'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.983778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1b18cb8a2447caaba2fd3d481c7303'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:37.988710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:38.008664 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1179/2372] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:37 2022] DELETE /identity/v3/users/7b1b18cb8a2447caaba2fd3d481c7303 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:38.015866 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc83a5-2994-4dd2-aa86-e74be337e06e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.016499 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc83a5-2994-4dd2-aa86-e74be337e06e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.016589 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc83a5-2994-4dd2-aa86-e74be337e06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.051566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-24fc83a5-2994-4dd2-aa86-e74be337e06e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:38.058832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-24fc83a5-2994-4dd2-aa86-e74be337e06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:38.138606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1194/2373] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:38.149956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:38.151657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:38.165519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc83a5-2994-4dd2-aa86-e74be337e06e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:38.167251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-24fc83a5-2994-4dd2-aa86-e74be337e06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:38.276700 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc83a5-2994-4dd2-aa86-e74be337e06e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:38.286985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed1b89-fddc-4bea-a580-a95800abf6fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3780488ee9404b3b8eda52acf8dceca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:38.289315 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1b89-fddc-4bea-a580-a95800abf6fb service glance] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.289719 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1b89-fddc-4bea-a580-a95800abf6fb service glance] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.290087 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1b89-fddc-4bea-a580-a95800abf6fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.293061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-32ed1b89-fddc-4bea-a580-a95800abf6fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:38.298342 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3fb70-f300-4e32-a2e2-6072776c7f2f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:38.302561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc1389-105d-41bf-a003-7ed708d33719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:38.304154 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc1389-105d-41bf-a003-7ed708d33719 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.304724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc1389-105d-41bf-a003-7ed708d33719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.305083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc1389-105d-41bf-a003-7ed708d33719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.317285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc1389-105d-41bf-a003-7ed708d33719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:38.319275 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc1389-105d-41bf-a003-7ed708d33719 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:38.340993 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1180/2374] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:38.392186 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed1b89-fddc-4bea-a580-a95800abf6fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:38.395020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed1b89-fddc-4bea-a580-a95800abf6fb service glance] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:38.410425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1195/2375] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:38.624437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556813f2-a99e-45f0-bd26-6fffc2c55870 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.625119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556813f2-a99e-45f0-bd26-6fffc2c55870 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.625565 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556813f2-a99e-45f0-bd26-6fffc2c55870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.649653 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-556813f2-a99e-45f0-bd26-6fffc2c55870 None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:38.650927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-556813f2-a99e-45f0-bd26-6fffc2c55870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:38.737871 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed1b89-fddc-4bea-a580-a95800abf6fb service glance] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:38.739343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-32ed1b89-fddc-4bea-a580-a95800abf6fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:38.755054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1181/2376] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:15:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:38.768666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556813f2-a99e-45f0-bd26-6fffc2c55870 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:38.770966 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-556813f2-a99e-45f0-bd26-6fffc2c55870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:38.782328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed1b89-fddc-4bea-a580-a95800abf6fb service glance] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:38.790263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:38.791147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.791440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.791712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] PATH_INFO: `/v3/projects/2d4a23d5a592413c8f70004addd84bc3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.794582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4a23d5a592413c8f70004addd84bc3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:38.796540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:38.852280 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:38.872522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4a23d5a592413c8f70004addd84bc3', 'request_id': 'req-a3294af3-ee82-45b5-aa94-4b8820ed583c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:38.876589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556813f2-a99e-45f0-bd26-6fffc2c55870 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:38.880591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:38.880894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4a23d5a592413c8f70004addd84bc3', 'request_id': 'req-a3294af3-ee82-45b5-aa94-4b8820ed583c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:38.899615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4a23d5a592413c8f70004addd84bc3', 'request_id': 'req-a3294af3-ee82-45b5-aa94-4b8820ed583c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:38.920069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] The token cache is being invalidate because project 2d4a23d5a592413c8f70004addd84bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:38.920606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:38.921475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a3294af3-ee82-45b5-aa94-4b8820ed583c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:38.923465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1196/2377] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:38 2022] DELETE /identity/v3/projects/2d4a23d5a592413c8f70004addd84bc3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:38.929760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5d1f8-4513-4533-be82-f0e75183d6b2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.930022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5d1f8-4513-4533-be82-f0e75183d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.930428 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5d1f8-4513-4533-be82-f0e75183d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.961278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08adb8-088f-4fe0-827a-a634bbcc863d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:38.962155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08adb8-088f-4fe0-827a-a634bbcc863d service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:38.964776 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08adb8-088f-4fe0-827a-a634bbcc863d service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:38.964776 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08adb8-088f-4fe0-827a-a634bbcc863d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:38.965124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0d08adb8-088f-4fe0-827a-a634bbcc863d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:38.986443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3bc5d1f8-4513-4533-be82-f0e75183d6b2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:38.987930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3bc5d1f8-4513-4533-be82-f0e75183d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:39.069399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08adb8-088f-4fe0-827a-a634bbcc863d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:39.071061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08adb8-088f-4fe0-827a-a634bbcc863d service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:39.083430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1197/2378] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:39.085103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95158756-a109-470f-b69a-8501cc4f366e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:39.085501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95158756-a109-470f-b69a-8501cc4f366e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:39.086175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95158756-a109-470f-b69a-8501cc4f366e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:39.090199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1182/2379] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:15:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:15:39.108346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-95158756-a109-470f-b69a-8501cc4f366e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:39.109668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-95158756-a109-470f-b69a-8501cc4f366e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:39.119030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1198/2380] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:39.124764 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08adb8-088f-4fe0-827a-a634bbcc863d service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:39.149822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08adb8-088f-4fe0-827a-a634bbcc863d service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:39.154719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5be43e-09f7-44c1-9f30-d0b097c729a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:39.155399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5be43e-09f7-44c1-9f30-d0b097c729a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:39.155690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5be43e-09f7-44c1-9f30-d0b097c729a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:39.156354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5be43e-09f7-44c1-9f30-d0b097c729a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:39.158015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5be43e-09f7-44c1-9f30-d0b097c729a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:15:39.158015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5be43e-09f7-44c1-9f30-d0b097c729a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:39.159314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5be43e-09f7-44c1-9f30-d0b097c729a5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:39.182904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1183/2381] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:15:39.184462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95158756-a109-470f-b69a-8501cc4f366e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:39.198305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95158756-a109-470f-b69a-8501cc4f366e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:39.210524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a5cc1-19be-4713-8d82-810f1b625961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:39.211592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a5cc1-19be-4713-8d82-810f1b625961 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:39.212089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a5cc1-19be-4713-8d82-810f1b625961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:39.212726 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a5cc1-19be-4713-8d82-810f1b625961 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:39.213534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a5cc1-19be-4713-8d82-810f1b625961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:39.215690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a5cc1-19be-4713-8d82-810f1b625961 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:39.266234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1199/2382] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:15:39 2022] POST /identity/v3/projects => generated 395 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:39.267511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5be43e-09f7-44c1-9f30-d0b097c729a5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:39.285975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5be43e-09f7-44c1-9f30-d0b097c729a5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:39.438643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372be2a-5fcc-4d0c-825a-87518a06f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:39.441875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372be2a-5fcc-4d0c-825a-87518a06f453 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:39.444695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372be2a-5fcc-4d0c-825a-87518a06f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:39.445179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372be2a-5fcc-4d0c-825a-87518a06f453 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:39.446074 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372be2a-5fcc-4d0c-825a-87518a06f453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:39.448209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372be2a-5fcc-4d0c-825a-87518a06f453 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:39.495954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1184/2383] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:15:39 2022] POST /identity/v3/users => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:15:39.497658 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a5cc1-19be-4713-8d82-810f1b625961 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:39.513474 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a5cc1-19be-4713-8d82-810f1b625961 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:39.525888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7b1b7-0626-4552-be58-a6ad454dcaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:39.526553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b1b7-0626-4552-be58-a6ad454dcaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:39.526970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b1b7-0626-4552-be58-a6ad454dcaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:39.527114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b1b7-0626-4552-be58-a6ad454dcaa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:39.527845 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7b1b7-0626-4552-be58-a6ad454dcaa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:39.529715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7b1b7-0626-4552-be58-a6ad454dcaa2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:39.556244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1200/2384] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:39.558077 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372be2a-5fcc-4d0c-825a-87518a06f453 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:39.573039 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372be2a-5fcc-4d0c-825a-87518a06f453 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:39.580599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4ea1-bbf3-42f4-a03c-70ab2594bd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:39.581585 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4ea1-bbf3-42f4-a03c-70ab2594bd47 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:39.582199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4ea1-bbf3-42f4-a03c-70ab2594bd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:39.582678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4ea1-bbf3-42f4-a03c-70ab2594bd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:39.583627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4ea1-bbf3-42f4-a03c-70ab2594bd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:39.586106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4ea1-bbf3-42f4-a03c-70ab2594bd47 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:39.606655 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1185/2385] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:15:39.607567 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7b1b7-0626-4552-be58-a6ad454dcaa2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:39.630143 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7b1b7-0626-4552-be58-a6ad454dcaa2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:39.635356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aa29d-ab80-45b6-993f-75be02333685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:39.636264 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aa29d-ab80-45b6-993f-75be02333685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:39.636550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aa29d-ab80-45b6-993f-75be02333685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:39.636873 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aa29d-ab80-45b6-993f-75be02333685 admin admin] PATH_INFO: `/v3/projects/3861abb94a524ac987ae5f487d327c7e/users/db1f8f5462744703b915f1366287ac56/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:39.671055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aa29d-ab80-45b6-993f-75be02333685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3861abb94a524ac987ae5f487d327c7e, user_id=db1f8f5462744703b915f1366287ac56, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:39.675219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aa29d-ab80-45b6-993f-75be02333685 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:39.705962 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1201/2386] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:15:39 2022] PUT /identity/v3/projects/3861abb94a524ac987ae5f487d327c7e/users/db1f8f5462744703b915f1366287ac56/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:15:39.708248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dbf9d-f213-4b7d-8b09-a7f4f373b5c8 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:39.708492 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dbf9d-f213-4b7d-8b09-a7f4f373b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:39.708957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dbf9d-f213-4b7d-8b09-a7f4f373b5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:39.746470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:39.754286 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-313dbf9d-f213-4b7d-8b09-a7f4f373b5c8 None None] MFA Rules not processed for user `db1f8f5462744703b915f1366287ac56`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:39.759577 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-313dbf9d-f213-4b7d-8b09-a7f4f373b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:39.900662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1186/2387] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:39.933270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aa29d-ab80-45b6-993f-75be02333685 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:39.935465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a86aa29d-ab80-45b6-993f-75be02333685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:40.019519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:40.034173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aa29d-ab80-45b6-993f-75be02333685 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:40.043029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa70ff3-6fb5-40ff-a7e4-7f17f0adc841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:40.043905 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70ff3-6fb5-40ff-a7e4-7f17f0adc841 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:40.044268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70ff3-6fb5-40ff-a7e4-7f17f0adc841 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:40.044639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa70ff3-6fb5-40ff-a7e4-7f17f0adc841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:40.058770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa70ff3-6fb5-40ff-a7e4-7f17f0adc841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:40.060342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa70ff3-6fb5-40ff-a7e4-7f17f0adc841 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:40.074924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1202/2388] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:45.853687 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dbf9d-f213-4b7d-8b09-a7f4f373b5c8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:46.041710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dbf9d-f213-4b7d-8b09-a7f4f373b5c8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:46.047511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:46.048869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:46.049378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:46.049909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] PATH_INFO: `/v3/users/db1f8f5462744703b915f1366287ac56` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:46.051744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1f8f5462744703b915f1366287ac56)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:46.055012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:46.150155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1f8f5462744703b915f1366287ac56'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:46.163447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1f8f5462744703b915f1366287ac56'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:46.164085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1f8f5462744703b915f1366287ac56'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:46.164738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1f8f5462744703b915f1366287ac56'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:46.189550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1f8f5462744703b915f1366287ac56'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:46.211001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1187/2389] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:45 2022] DELETE /identity/v3/users/db1f8f5462744703b915f1366287ac56 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:15:46.215261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05040c08-19b1-44f1-a2c3-72987cae4107 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:46.215831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05040c08-19b1-44f1-a2c3-72987cae4107 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:46.215831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05040c08-19b1-44f1-a2c3-72987cae4107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:46.246468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-05040c08-19b1-44f1-a2c3-72987cae4107 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:46.247707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-05040c08-19b1-44f1-a2c3-72987cae4107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:46.376501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1203/2390] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:46.389065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:46.392142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:46.426262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:46.470888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e5f5-9dd6-4925-aab5-633f3a1edc3b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:46.476185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a659db-c8e2-49d5-b369-15d4de5c3591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:46.477203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a659db-c8e2-49d5-b369-15d4de5c3591 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:46.477721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a659db-c8e2-49d5-b369-15d4de5c3591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:46.478236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a659db-c8e2-49d5-b369-15d4de5c3591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:46.496086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a659db-c8e2-49d5-b369-15d4de5c3591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:46.498017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a659db-c8e2-49d5-b369-15d4de5c3591 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:46.512297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1188/2391] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:46.967976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05040c08-19b1-44f1-a2c3-72987cae4107 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:46.969867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-05040c08-19b1-44f1-a2c3-72987cae4107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:47.001869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05040c08-19b1-44f1-a2c3-72987cae4107 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:47.018886 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:47.020124 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:47.020589 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:47.020903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] PATH_INFO: `/v3/projects/3861abb94a524ac987ae5f487d327c7e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:47.025083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3861abb94a524ac987ae5f487d327c7e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:47.027418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:47.137507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3861abb94a524ac987ae5f487d327c7e', 'request_id': 'req-f66dc5b4-13db-4222-a8f1-8e560776a7bf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:47.149318 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3861abb94a524ac987ae5f487d327c7e', 'request_id': 'req-f66dc5b4-13db-4222-a8f1-8e560776a7bf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:47.166014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3861abb94a524ac987ae5f487d327c7e', 'request_id': 'req-f66dc5b4-13db-4222-a8f1-8e560776a7bf'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:47.187681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] The token cache is being invalidate because project 3861abb94a524ac987ae5f487d327c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:47.188444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:47.190021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f66dc5b4-13db-4222-a8f1-8e560776a7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:47.195151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1204/2392] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:46 2022] DELETE /identity/v3/projects/3861abb94a524ac987ae5f487d327c7e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:49.744552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc263-19eb-4107-9c5f-0dd0524be41a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:49.745161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc263-19eb-4107-9c5f-0dd0524be41a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:49.745266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fc263-19eb-4107-9c5f-0dd0524be41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:49.782495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-341fc263-19eb-4107-9c5f-0dd0524be41a None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:49.783706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-341fc263-19eb-4107-9c5f-0dd0524be41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:49.831119 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8118a4f-3a3c-482e-a4e1-f13a385dd57e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:49.831744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8118a4f-3a3c-482e-a4e1-f13a385dd57e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:49.831744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8118a4f-3a3c-482e-a4e1-f13a385dd57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:49.849200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1189/2393] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jun 20 06:15:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:49.851173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d8118a4f-3a3c-482e-a4e1-f13a385dd57e None None] MFA Rules not processed for user `6734724f68514b3190569f02e3d08ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:49.852947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d8118a4f-3a3c-482e-a4e1-f13a385dd57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:49.864572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fc263-19eb-4107-9c5f-0dd0524be41a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:49.867098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-341fc263-19eb-4107-9c5f-0dd0524be41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:49.914735 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1205/2394] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:15:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:49.953599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fc263-19eb-4107-9c5f-0dd0524be41a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:49.959633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06eae-09ee-4351-9926-4974947aecd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:49.960281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06eae-09ee-4351-9926-4974947aecd7 service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:49.960570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06eae-09ee-4351-9926-4974947aecd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:49.960883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06eae-09ee-4351-9926-4974947aecd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:49.970066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06eae-09ee-4351-9926-4974947aecd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:49.971605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06eae-09ee-4351-9926-4974947aecd7 service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:49.980487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1190/2395] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:15:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:15:52.125605 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc904f-21ef-42c9-bf47-85dfc00de8e9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:52.126694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc904f-21ef-42c9-bf47-85dfc00de8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:52.127299 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc904f-21ef-42c9-bf47-85dfc00de8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:52.148742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-dfdc904f-21ef-42c9-bf47-85dfc00de8e9 None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:52.150374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-dfdc904f-21ef-42c9-bf47-85dfc00de8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:52.178359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06eae-09ee-4351-9926-4974947aecd7 service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:52.187529 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1206/2396] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:15:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:52.194901 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06eae-09ee-4351-9926-4974947aecd7 service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:52.208746 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fb3d2-e341-4528-9e41-2f1543d782fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:52.209751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb3d2-e341-4528-9e41-2f1543d782fc service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:52.210051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb3d2-e341-4528-9e41-2f1543d782fc service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:52.210337 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb3d2-e341-4528-9e41-2f1543d782fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:52.221543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fb3d2-e341-4528-9e41-2f1543d782fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:52.223288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fb3d2-e341-4528-9e41-2f1543d782fc service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:52.232892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1191/2397] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:15:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 06:15:52.534952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc904f-21ef-42c9-bf47-85dfc00de8e9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:52.537058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-dfdc904f-21ef-42c9-bf47-85dfc00de8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:52.572649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:52.729210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc904f-21ef-42c9-bf47-85dfc00de8e9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:52.741359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:52.742268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:52.742556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:52.742843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] PATH_INFO: `/v3/users/eda7e570a1b54240b8f956cccc498f06` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:52.745423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda7e570a1b54240b8f956cccc498f06)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:52.747421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:52.846926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda7e570a1b54240b8f956cccc498f06'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:52.868106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda7e570a1b54240b8f956cccc498f06'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:52.868906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda7e570a1b54240b8f956cccc498f06'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:52.873173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda7e570a1b54240b8f956cccc498f06'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:52.900968 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda7e570a1b54240b8f956cccc498f06'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:52.935107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1207/2398] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:52 2022] DELETE /identity/v3/users/eda7e570a1b54240b8f956cccc498f06 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:53.290823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fb3d2-e341-4528-9e41-2f1543d782fc service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:53.304464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fb3d2-e341-4528-9e41-2f1543d782fc service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:53.391104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:53.418703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:53.419675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:53.420117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:53.420490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] PATH_INFO: `/v3/projects/d0ebc34632424ea59f55118f123cb99d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:53.422076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ebc34632424ea59f55118f123cb99d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:53.424296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:53.532235 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ebc34632424ea59f55118f123cb99d', 'request_id': 'req-190a87aa-0585-4596-bfab-b53339c97056'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:53.540274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ebc34632424ea59f55118f123cb99d', 'request_id': 'req-190a87aa-0585-4596-bfab-b53339c97056'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:53.546410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ebc34632424ea59f55118f123cb99d', 'request_id': 'req-190a87aa-0585-4596-bfab-b53339c97056'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:53.569610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] The token cache is being invalidate because project d0ebc34632424ea59f55118f123cb99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:53.570008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:53.570800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-190a87aa-0585-4596-bfab-b53339c97056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:53.572642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1192/2399] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:53 2022] DELETE /identity/v3/projects/d0ebc34632424ea59f55118f123cb99d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:16:02.923641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:03.565811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:09.657881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:09.659301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:09.676144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05b718-0872-4c63-9f4f-349fce07ebde admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:09.746701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:09.747980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:09.748310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:09.748603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] PATH_INFO: `/v3/users/e16c919517bb43bfa552e00b9ae1595b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:09.750445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16c919517bb43bfa552e00b9ae1595b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:09.753289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:09.799174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16c919517bb43bfa552e00b9ae1595b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:09.806237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16c919517bb43bfa552e00b9ae1595b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:09.806895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16c919517bb43bfa552e00b9ae1595b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:09.807496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16c919517bb43bfa552e00b9ae1595b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:09.822880 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16c919517bb43bfa552e00b9ae1595b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:09.835114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1208/2400] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:16:09 2022] DELETE /identity/v3/users/e16c919517bb43bfa552e00b9ae1595b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:16:09.839905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75801998-a289-4ba1-899b-74a0f40d8811 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:09.840570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75801998-a289-4ba1-899b-74a0f40d8811 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:09.840570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75801998-a289-4ba1-899b-74a0f40d8811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:09.860043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-75801998-a289-4ba1-899b-74a0f40d8811 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:09.862819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-75801998-a289-4ba1-899b-74a0f40d8811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:09.928418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1193/2401] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:09.938546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:09.940083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:10.023744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111add6a-64f7-4b05-9d90-f5f5d353c589 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:10.032166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e35954-4863-4892-a07f-12cbee0b6d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:10.033101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35954-4863-4892-a07f-12cbee0b6d85 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:10.033875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35954-4863-4892-a07f-12cbee0b6d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:10.034165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35954-4863-4892-a07f-12cbee0b6d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:10.046804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e35954-4863-4892-a07f-12cbee0b6d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:10.048268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e35954-4863-4892-a07f-12cbee0b6d85 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:10.063766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1209/2402] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:11.004193 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75801998-a289-4ba1-899b-74a0f40d8811 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:11.005963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-75801998-a289-4ba1-899b-74a0f40d8811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:11.038697 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75801998-a289-4ba1-899b-74a0f40d8811 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:11.045387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:11.046645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:11.047289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:11.047666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] PATH_INFO: `/v3/projects/54e970b0876749858ee74692e2f02e7c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:11.049878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e970b0876749858ee74692e2f02e7c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:11.052518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:11.104425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e970b0876749858ee74692e2f02e7c', 'request_id': 'req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:11.112554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e970b0876749858ee74692e2f02e7c', 'request_id': 'req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:11.122317 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e970b0876749858ee74692e2f02e7c', 'request_id': 'req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:11.138718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] The token cache is being invalidate because project 54e970b0876749858ee74692e2f02e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:16:11.139074 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:11.139660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-51ff758d-53c6-4fd3-a591-cca0b7f8b14c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:11.141252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1194/2403] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:16:11 2022] DELETE /identity/v3/projects/54e970b0876749858ee74692e2f02e7c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:16:11.146382 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b49ff-58b6-4cfa-87f3-bacb371a1da9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:11.146905 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b49ff-58b6-4cfa-87f3-bacb371a1da9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:11.147011 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b49ff-58b6-4cfa-87f3-bacb371a1da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:11.209412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8b8b49ff-58b6-4cfa-87f3-bacb371a1da9 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:11.211063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8b8b49ff-58b6-4cfa-87f3-bacb371a1da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:11.221162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:11.291413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1210/2404] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:16:11.301183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1fc8-0a19-496e-afe2-27d1b4e9e34e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:11.301507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1fc8-0a19-496e-afe2-27d1b4e9e34e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:11.301796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a1fc8-0a19-496e-afe2-27d1b4e9e34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:11.323791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-367a1fc8-0a19-496e-afe2-27d1b4e9e34e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:11.325055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-367a1fc8-0a19-496e-afe2-27d1b4e9e34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:11.334076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1195/2405] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:11.338134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b49ff-58b6-4cfa-87f3-bacb371a1da9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:11.348644 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b49ff-58b6-4cfa-87f3-bacb371a1da9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:11.353849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e679a9c-f406-488a-9226-11d2ae1aadc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:11.355298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e679a9c-f406-488a-9226-11d2ae1aadc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:11.355600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e679a9c-f406-488a-9226-11d2ae1aadc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:11.356038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e679a9c-f406-488a-9226-11d2ae1aadc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:11.357002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e679a9c-f406-488a-9226-11d2ae1aadc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:16:11.357314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e679a9c-f406-488a-9226-11d2ae1aadc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:11.358956 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e679a9c-f406-488a-9226-11d2ae1aadc8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:11.373090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1211/2406] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:16:11.378157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a1fc8-0a19-496e-afe2-27d1b4e9e34e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:11.387223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a1fc8-0a19-496e-afe2-27d1b4e9e34e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:11.391937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0baf8b-50da-4049-acb5-60482e40f00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:11.392595 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0baf8b-50da-4049-acb5-60482e40f00c admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:11.392925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0baf8b-50da-4049-acb5-60482e40f00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:11.393207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0baf8b-50da-4049-acb5-60482e40f00c admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:11.393897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0baf8b-50da-4049-acb5-60482e40f00c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:11.395798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0baf8b-50da-4049-acb5-60482e40f00c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:11.428742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1196/2407] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:16:11 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:16:11.429874 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e679a9c-f406-488a-9226-11d2ae1aadc8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:11.440401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e679a9c-f406-488a-9226-11d2ae1aadc8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:11.498804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d3b7b-ba13-415c-b963-82c99e12e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:11.499473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d3b7b-ba13-415c-b963-82c99e12e173 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:11.499761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d3b7b-ba13-415c-b963-82c99e12e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:11.500039 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d3b7b-ba13-415c-b963-82c99e12e173 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:11.500761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d3b7b-ba13-415c-b963-82c99e12e173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:11.502695 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d3b7b-ba13-415c-b963-82c99e12e173 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:11.524912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1212/2408] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:16:11 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:16:11.526073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0baf8b-50da-4049-acb5-60482e40f00c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:11.537514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0baf8b-50da-4049-acb5-60482e40f00c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:11.542129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290144-636b-4f72-93a0-486c8722ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:11.543452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290144-636b-4f72-93a0-486c8722ab4b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:11.543738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290144-636b-4f72-93a0-486c8722ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:11.544013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290144-636b-4f72-93a0-486c8722ab4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:11.544791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd290144-636b-4f72-93a0-486c8722ab4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:11.546401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd290144-636b-4f72-93a0-486c8722ab4b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:11.556836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1197/2409] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:16:11.560604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d3b7b-ba13-415c-b963-82c99e12e173 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:11.570555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d3b7b-ba13-415c-b963-82c99e12e173 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:11.575904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ae810-6f47-4f8a-a6a9-8299b0e3b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:11.576604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae810-6f47-4f8a-a6a9-8299b0e3b2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:11.576913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae810-6f47-4f8a-a6a9-8299b0e3b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:11.577192 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae810-6f47-4f8a-a6a9-8299b0e3b2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:11.577917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ae810-6f47-4f8a-a6a9-8299b0e3b2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:11.579548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ae810-6f47-4f8a-a6a9-8299b0e3b2d6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:11.590284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1213/2410] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:16:11.594391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290144-636b-4f72-93a0-486c8722ab4b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:11.604226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290144-636b-4f72-93a0-486c8722ab4b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:11.609618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec84edf-6185-4b6a-8f3a-9c8c82cac8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:11.610440 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec84edf-6185-4b6a-8f3a-9c8c82cac8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:11.610727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec84edf-6185-4b6a-8f3a-9c8c82cac8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:11.611006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec84edf-6185-4b6a-8f3a-9c8c82cac8f3 admin admin] PATH_INFO: `/v3/projects/0c31b8657ce1488388a9f5017e2a799c/users/4be10f7844e84e138c6ea46559e3069a/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:11.626579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec84edf-6185-4b6a-8f3a-9c8c82cac8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c31b8657ce1488388a9f5017e2a799c, user_id=4be10f7844e84e138c6ea46559e3069a, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:11.629302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec84edf-6185-4b6a-8f3a-9c8c82cac8f3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:11.643012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1198/2411] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:16:11 2022] PUT /identity/v3/projects/0c31b8657ce1488388a9f5017e2a799c/users/4be10f7844e84e138c6ea46559e3069a/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:16:11.653360 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665f87-b305-4f21-b841-0f1c43bdb532 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:11.653652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665f87-b305-4f21-b841-0f1c43bdb532 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:11.653932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665f87-b305-4f21-b841-0f1c43bdb532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:11.680503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-31665f87-b305-4f21-b841-0f1c43bdb532 None None] MFA Rules not processed for user `4be10f7844e84e138c6ea46559e3069a`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:11.681731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-31665f87-b305-4f21-b841-0f1c43bdb532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:11.747221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1214/2412] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:16:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:11.758472 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec84edf-6185-4b6a-8f3a-9c8c82cac8f3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:11.760738 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6ec84edf-6185-4b6a-8f3a-9c8c82cac8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:11.784575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:11.846119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec84edf-6185-4b6a-8f3a-9c8c82cac8f3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:11.849821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2710e-213a-4be7-bfab-d37896630009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:11.850479 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2710e-213a-4be7-bfab-d37896630009 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:11.850767 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2710e-213a-4be7-bfab-d37896630009 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:11.851047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2710e-213a-4be7-bfab-d37896630009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:11.859784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2710e-213a-4be7-bfab-d37896630009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:11.861314 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2710e-213a-4be7-bfab-d37896630009 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:11.870170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1199/2413] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:13.218163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066374-5e92-4e44-a010-5127107c5aed None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:13.218712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066374-5e92-4e44-a010-5127107c5aed None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:13.218712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066374-5e92-4e44-a010-5127107c5aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:13.236680 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-94066374-5e92-4e44-a010-5127107c5aed None None] MFA Rules not processed for user `4be10f7844e84e138c6ea46559e3069a`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:13.238160 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-94066374-5e92-4e44-a010-5127107c5aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:13.245224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1215/2414] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:16:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:16.036827 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2710e-213a-4be7-bfab-d37896630009 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:16.038968 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f5b2710e-213a-4be7-bfab-d37896630009 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:16.156052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2710e-213a-4be7-bfab-d37896630009 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:16.161412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415fcf6-6342-49f6-aea4-41bdce99d9e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:16.162310 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415fcf6-6342-49f6-aea4-41bdce99d9e1 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:16.162592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415fcf6-6342-49f6-aea4-41bdce99d9e1 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:16.162869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415fcf6-6342-49f6-aea4-41bdce99d9e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:16.164988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f415fcf6-6342-49f6-aea4-41bdce99d9e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:16.177682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415fcf6-6342-49f6-aea4-41bdce99d9e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:16.179320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415fcf6-6342-49f6-aea4-41bdce99d9e1 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:16.189691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1200/2415] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:17.744272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06f2be-55be-499f-b6f1-8757ec805dc0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:17.744779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06f2be-55be-499f-b6f1-8757ec805dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:17.744897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06f2be-55be-499f-b6f1-8757ec805dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:17.751467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:17.767074 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8e06f2be-55be-499f-b6f1-8757ec805dc0 None None] MFA Rules not processed for user `21d8d5c8b45d4d15a60a66b955dc9617`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:17.768449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8e06f2be-55be-499f-b6f1-8757ec805dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:17.835798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1216/2416] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:16:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:26.185011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=67 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:27.828724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=24 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:33.691586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103478a5-af4d-45be-9527-6dc711f1a32e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:33.692184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103478a5-af4d-45be-9527-6dc711f1a32e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:33.692343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103478a5-af4d-45be-9527-6dc711f1a32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:33.749631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-103478a5-af4d-45be-9527-6dc711f1a32e None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:33.750891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-103478a5-af4d-45be-9527-6dc711f1a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:33.842257 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1201/2417] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:16:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:33.868193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06f2be-55be-499f-b6f1-8757ec805dc0 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:33.870655 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8e06f2be-55be-499f-b6f1-8757ec805dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:33.967662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06f2be-55be-499f-b6f1-8757ec805dc0 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:33.972804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a128e-ebf2-4ce4-b002-789d9492452f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:33.973454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a128e-ebf2-4ce4-b002-789d9492452f service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:33.973742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a128e-ebf2-4ce4-b002-789d9492452f service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:33.974023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a128e-ebf2-4ce4-b002-789d9492452f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:33.983096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a128e-ebf2-4ce4-b002-789d9492452f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:33.984738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a128e-ebf2-4ce4-b002-789d9492452f service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:33.992722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1217/2418] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:16:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:34.706398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103478a5-af4d-45be-9527-6dc711f1a32e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:34.711778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-103478a5-af4d-45be-9527-6dc711f1a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:34.797429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103478a5-af4d-45be-9527-6dc711f1a32e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:34.801073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4d744-98a8-4874-b20a-901e3a6d5a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:34.801667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d744-98a8-4874-b20a-901e3a6d5a92 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:34.801950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d744-98a8-4874-b20a-901e3a6d5a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:34.802226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d744-98a8-4874-b20a-901e3a6d5a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:34.807384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1bf4d744-98a8-4874-b20a-901e3a6d5a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:34.893473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4d744-98a8-4874-b20a-901e3a6d5a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:34.897672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4d744-98a8-4874-b20a-901e3a6d5a92 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:34.906125 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1202/2419] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:43.175379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e50c1-a800-4bc7-9a3e-6672fac5c4ee None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:43.176891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e50c1-a800-4bc7-9a3e-6672fac5c4ee None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:43.177463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e50c1-a800-4bc7-9a3e-6672fac5c4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:43.204587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e19e50c1-a800-4bc7-9a3e-6672fac5c4ee None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:43.205865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e19e50c1-a800-4bc7-9a3e-6672fac5c4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:43.225781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1218/2420] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:16:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:16:43.241586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4d744-98a8-4874-b20a-901e3a6d5a92 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:43.265542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4d744-98a8-4874-b20a-901e3a6d5a92 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:43.271249 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed88a7b-34be-47c1-b378-53436d609413 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:43.271922 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed88a7b-34be-47c1-b378-53436d609413 service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:43.272219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed88a7b-34be-47c1-b378-53436d609413 service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:43.272751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed88a7b-34be-47c1-b378-53436d609413 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:43.284779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed88a7b-34be-47c1-b378-53436d609413 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:43.286815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed88a7b-34be-47c1-b378-53436d609413 service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:43.299278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1203/2421] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:16:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:44.097485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f646-0fdf-40b2-8863-df5e22e19e4e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:44.098442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f646-0fdf-40b2-8863-df5e22e19e4e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:44.098984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f646-0fdf-40b2-8863-df5e22e19e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:44.137669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b890f646-0fdf-40b2-8863-df5e22e19e4e None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:44.140049 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b890f646-0fdf-40b2-8863-df5e22e19e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:44.150101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1219/2422] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jun 20 06:16:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:44.165772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed88a7b-34be-47c1-b378-53436d609413 service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:44.171793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:44.180296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed88a7b-34be-47c1-b378-53436d609413 service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:44.186884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31086d-db91-4671-a85c-278501ad8ee4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:44.187832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31086d-db91-4671-a85c-278501ad8ee4 service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:44.188308 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31086d-db91-4671-a85c-278501ad8ee4 service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:44.188815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31086d-db91-4671-a85c-278501ad8ee4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:44.202828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31086d-db91-4671-a85c-278501ad8ee4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:44.204942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31086d-db91-4671-a85c-278501ad8ee4 service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:44.223527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1204/2423] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:16:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:44.698274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c9987-4a8e-4081-89cc-4b137d4fbbb0 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:44.699844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c9987-4a8e-4081-89cc-4b137d4fbbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:44.700121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c9987-4a8e-4081-89cc-4b137d4fbbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:44.728981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-057c9987-4a8e-4081-89cc-4b137d4fbbb0 None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:44.730551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-057c9987-4a8e-4081-89cc-4b137d4fbbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:44.758578 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1220/2424] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:16:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:44.759972 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31086d-db91-4671-a85c-278501ad8ee4 service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:44.771836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31086d-db91-4671-a85c-278501ad8ee4 service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:44.777579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ffc0a-ce3d-49eb-a58a-ebfc4adf1458 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:44.778996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ffc0a-ce3d-49eb-a58a-ebfc4adf1458 service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:44.779516 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ffc0a-ce3d-49eb-a58a-ebfc4adf1458 service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:44.780020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ffc0a-ce3d-49eb-a58a-ebfc4adf1458 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:44.792501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ffc0a-ce3d-49eb-a58a-ebfc4adf1458 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:44.795320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ffc0a-ce3d-49eb-a58a-ebfc4adf1458 service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:44.806546 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1205/2425] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:16:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:45.272414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c72a3-7a36-4228-b0ac-c3d2df6aa809 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:45.272750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c72a3-7a36-4228-b0ac-c3d2df6aa809 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:45.273030 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c72a3-7a36-4228-b0ac-c3d2df6aa809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:45.293806 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7b1c72a3-7a36-4228-b0ac-c3d2df6aa809 None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:45.295033 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7b1c72a3-7a36-4228-b0ac-c3d2df6aa809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:45.312287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1221/2426] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jun 20 06:16:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:45.322047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ffc0a-ce3d-49eb-a58a-ebfc4adf1458 service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:45.335617 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ffc0a-ce3d-49eb-a58a-ebfc4adf1458 service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:45.342992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12f5a5-103f-4007-88f4-3ed4f235e77f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:45.343996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12f5a5-103f-4007-88f4-3ed4f235e77f service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:45.345106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12f5a5-103f-4007-88f4-3ed4f235e77f service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:45.345752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12f5a5-103f-4007-88f4-3ed4f235e77f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:45.358254 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12f5a5-103f-4007-88f4-3ed4f235e77f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:45.359892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12f5a5-103f-4007-88f4-3ed4f235e77f service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:45.369775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1206/2427] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:16:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:47.478467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c72a3-7a36-4228-b0ac-c3d2df6aa809 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:47.544760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c72a3-7a36-4228-b0ac-c3d2df6aa809 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:47.549562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:47.550445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:47.550763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:47.551045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] PATH_INFO: `/v3/users/4be10f7844e84e138c6ea46559e3069a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:47.552262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be10f7844e84e138c6ea46559e3069a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:47.554248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:47.601085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:47.602790 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be10f7844e84e138c6ea46559e3069a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:47.610483 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be10f7844e84e138c6ea46559e3069a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:47.611157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be10f7844e84e138c6ea46559e3069a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:47.611771 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be10f7844e84e138c6ea46559e3069a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:47.627122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be10f7844e84e138c6ea46559e3069a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:47.641023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1222/2428] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:16:47 2022] DELETE /identity/v3/users/4be10f7844e84e138c6ea46559e3069a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:16:47.645441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4c04-cc2f-43e8-a028-655c3dfce965 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:47.645917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4c04-cc2f-43e8-a028-655c3dfce965 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:47.646021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d4c04-cc2f-43e8-a028-655c3dfce965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:47.663742 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-198d4c04-cc2f-43e8-a028-655c3dfce965 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:47.664975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-198d4c04-cc2f-43e8-a028-655c3dfce965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:47.722404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1207/2429] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:47.737524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:47.738971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:47.796554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fa715-28dd-4d27-91c8-792b5de3dd9e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:47.800161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98516ce-4bd1-40a1-939a-6afcd2b5a02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:47.800835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98516ce-4bd1-40a1-939a-6afcd2b5a02c service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:47.801118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98516ce-4bd1-40a1-939a-6afcd2b5a02c service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:47.801391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98516ce-4bd1-40a1-939a-6afcd2b5a02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:47.811015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98516ce-4bd1-40a1-939a-6afcd2b5a02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:47.812463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98516ce-4bd1-40a1-939a-6afcd2b5a02c service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:47.822032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1223/2430] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:47.992576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d4c04-cc2f-43e8-a028-655c3dfce965 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:47.994044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-198d4c04-cc2f-43e8-a028-655c3dfce965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:48.008145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d4c04-cc2f-43e8-a028-655c3dfce965 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:48.014137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:48.015279 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:48.015573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:48.015965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] PATH_INFO: `/v3/projects/0c31b8657ce1488388a9f5017e2a799c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:48.017130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c31b8657ce1488388a9f5017e2a799c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:48.019013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:48.066936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c31b8657ce1488388a9f5017e2a799c', 'request_id': 'req-589b5df0-4814-4399-8498-7af741d4f55e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:48.073201 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c31b8657ce1488388a9f5017e2a799c', 'request_id': 'req-589b5df0-4814-4399-8498-7af741d4f55e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:48.079438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c31b8657ce1488388a9f5017e2a799c', 'request_id': 'req-589b5df0-4814-4399-8498-7af741d4f55e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:48.093383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] The token cache is being invalidate because project 0c31b8657ce1488388a9f5017e2a799c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:16:48.093679 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:48.094311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-589b5df0-4814-4399-8498-7af741d4f55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:48.095844 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1208/2431] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:16:47 2022] DELETE /identity/v3/projects/0c31b8657ce1488388a9f5017e2a799c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:16:48.100751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a83863-7d9d-44b7-b275-d421a796d7ff None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:48.101044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a83863-7d9d-44b7-b275-d421a796d7ff None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:48.101381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a83863-7d9d-44b7-b275-d421a796d7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:48.118759 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-d2a83863-7d9d-44b7-b275-d421a796d7ff None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:48.119958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d2a83863-7d9d-44b7-b275-d421a796d7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:48.178877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1224/2432] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:48.187523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee449f8c-3419-4b76-b781-2c9fdc7898fb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:48.187964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee449f8c-3419-4b76-b781-2c9fdc7898fb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:48.188358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee449f8c-3419-4b76-b781-2c9fdc7898fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:48.207144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ee449f8c-3419-4b76-b781-2c9fdc7898fb None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:48.208336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ee449f8c-3419-4b76-b781-2c9fdc7898fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:48.216894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1209/2433] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:16:48.220941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a83863-7d9d-44b7-b275-d421a796d7ff None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:48.230714 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a83863-7d9d-44b7-b275-d421a796d7ff None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:48.235351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf85c-6dbb-41c5-913e-d5d9186bfac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:48.235999 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf85c-6dbb-41c5-913e-d5d9186bfac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:48.236287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf85c-6dbb-41c5-913e-d5d9186bfac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:48.236566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf85c-6dbb-41c5-913e-d5d9186bfac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:48.237329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cf85c-6dbb-41c5-913e-d5d9186bfac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:16:48.237641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cf85c-6dbb-41c5-913e-d5d9186bfac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:48.239242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cf85c-6dbb-41c5-913e-d5d9186bfac6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:48.251591 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1225/2434] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:16:48.256529 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee449f8c-3419-4b76-b781-2c9fdc7898fb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:48.266318 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee449f8c-3419-4b76-b781-2c9fdc7898fb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:48.271037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c20cb9-5b2f-484e-8f3e-5e3173744f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:48.271715 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c20cb9-5b2f-484e-8f3e-5e3173744f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:48.272009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c20cb9-5b2f-484e-8f3e-5e3173744f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:48.272287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c20cb9-5b2f-484e-8f3e-5e3173744f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:48.273028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c20cb9-5b2f-484e-8f3e-5e3173744f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:48.274934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c20cb9-5b2f-484e-8f3e-5e3173744f0f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:48.300083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1210/2435] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:16:48 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:16:48.304079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf85c-6dbb-41c5-913e-d5d9186bfac6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:48.314439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf85c-6dbb-41c5-913e-d5d9186bfac6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:48.362094 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:48.374269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9f49-375c-4c81-8852-18f4ad249de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:48.375195 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9f49-375c-4c81-8852-18f4ad249de5 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:48.375641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9f49-375c-4c81-8852-18f4ad249de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:48.376196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9f49-375c-4c81-8852-18f4ad249de5 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:48.377153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b9f49-375c-4c81-8852-18f4ad249de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:48.379310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b9f49-375c-4c81-8852-18f4ad249de5 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:48.402988 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1226/2436] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:16:48 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:16:48.404196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c20cb9-5b2f-484e-8f3e-5e3173744f0f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:48.415066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c20cb9-5b2f-484e-8f3e-5e3173744f0f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:48.420299 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859e7c7-c855-442d-b3f1-e56836cb17a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:48.421149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859e7c7-c855-442d-b3f1-e56836cb17a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:48.421461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859e7c7-c855-442d-b3f1-e56836cb17a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:48.421741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859e7c7-c855-442d-b3f1-e56836cb17a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:48.422487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859e7c7-c855-442d-b3f1-e56836cb17a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:48.424131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859e7c7-c855-442d-b3f1-e56836cb17a0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:48.438571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1211/2437] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:16:48.443043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9f49-375c-4c81-8852-18f4ad249de5 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:48.454513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9f49-375c-4c81-8852-18f4ad249de5 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:48.459531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832caff5-9729-45f3-884e-d0c7e53c15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:48.460413 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832caff5-9729-45f3-884e-d0c7e53c15f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:48.460891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832caff5-9729-45f3-884e-d0c7e53c15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:48.461175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832caff5-9729-45f3-884e-d0c7e53c15f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:48.461913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832caff5-9729-45f3-884e-d0c7e53c15f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:48.463564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832caff5-9729-45f3-884e-d0c7e53c15f6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:48.475401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1227/2438] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:16:48.479531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859e7c7-c855-442d-b3f1-e56836cb17a0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:48.490716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859e7c7-c855-442d-b3f1-e56836cb17a0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:48.496268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21796c-6515-4f62-acd3-44ffc476b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:48.497741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21796c-6515-4f62-acd3-44ffc476b8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:48.498025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21796c-6515-4f62-acd3-44ffc476b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:48.498302 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21796c-6515-4f62-acd3-44ffc476b8cf admin admin] PATH_INFO: `/v3/projects/550e7ce9112b4d0384f3e0cabadb81dd/users/57bd74ac650548ffae959ed97034c059/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:48.503871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:48.519600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21796c-6515-4f62-acd3-44ffc476b8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=550e7ce9112b4d0384f3e0cabadb81dd, user_id=57bd74ac650548ffae959ed97034c059, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:48.522358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21796c-6515-4f62-acd3-44ffc476b8cf admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:48.534880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1212/2439] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:16:48 2022] PUT /identity/v3/projects/550e7ce9112b4d0384f3e0cabadb81dd/users/57bd74ac650548ffae959ed97034c059/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:16:48.540164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e790ec-ca44-487a-8eb5-771ec3c211eb None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:48.540647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e790ec-ca44-487a-8eb5-771ec3c211eb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:48.540757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e790ec-ca44-487a-8eb5-771ec3c211eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:48.559285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f5e790ec-ca44-487a-8eb5-771ec3c211eb None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:48.560482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f5e790ec-ca44-487a-8eb5-771ec3c211eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:48.619078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1228/2440] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:48.629415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21796c-6515-4f62-acd3-44ffc476b8cf admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:48.631179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fe21796c-6515-4f62-acd3-44ffc476b8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:48.688456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21796c-6515-4f62-acd3-44ffc476b8cf admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:48.692092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860d7c3-e989-4f05-b9c0-112bc505fb09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:48.692760 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d7c3-e989-4f05-b9c0-112bc505fb09 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:48.693044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d7c3-e989-4f05-b9c0-112bc505fb09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:48.693321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d7c3-e989-4f05-b9c0-112bc505fb09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:48.702773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860d7c3-e989-4f05-b9c0-112bc505fb09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:48.704178 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860d7c3-e989-4f05-b9c0-112bc505fb09 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:48.713412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1213/2441] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:50.542107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c881d-f7f8-4258-82e9-2a0f928c442d None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:50.543890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c881d-f7f8-4258-82e9-2a0f928c442d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:50.544177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c881d-f7f8-4258-82e9-2a0f928c442d None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:50.545619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1229/2442] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:16:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:16:50.552444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680799a-c374-45a3-bc06-f68351bb0d9c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:50.552947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680799a-c374-45a3-bc06-f68351bb0d9c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:50.553054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680799a-c374-45a3-bc06-f68351bb0d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:50.613386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c680799a-c374-45a3-bc06-f68351bb0d9c None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:50.614970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c680799a-c374-45a3-bc06-f68351bb0d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:50.702619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1214/2443] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:16:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:50.719654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c881d-f7f8-4258-82e9-2a0f928c442d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:50.721885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ac7c881d-f7f8-4258-82e9-2a0f928c442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:50.817995 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c881d-f7f8-4258-82e9-2a0f928c442d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:50.821906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214d591-6b28-411a-942e-8f49509e784b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3780488ee9404b3b8eda52acf8dceca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:50.822649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214d591-6b28-411a-942e-8f49509e784b service glance] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:50.823010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214d591-6b28-411a-942e-8f49509e784b service glance] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:50.823389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214d591-6b28-411a-942e-8f49509e784b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:50.834900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214d591-6b28-411a-942e-8f49509e784b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:50.836449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214d591-6b28-411a-942e-8f49509e784b service glance] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:50.849097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1230/2444] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:16:50.922522 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11a30-244f-4940-973a-0971ab81e984 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:50.922947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11a30-244f-4940-973a-0971ab81e984 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:50.923117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11a30-244f-4940-973a-0971ab81e984 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:50.924696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1215/2445] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:16:50.934047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51380e-7e99-4c2b-9746-89eb8916ebd9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:50.934399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51380e-7e99-4c2b-9746-89eb8916ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:50.934675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51380e-7e99-4c2b-9746-89eb8916ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:50.960313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-bb51380e-7e99-4c2b-9746-89eb8916ebd9 None None] MFA Rules not processed for user `9d21089ce5b140ab9549816b8cb38316`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:50.961479 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bb51380e-7e99-4c2b-9746-89eb8916ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:50.969737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1231/2446] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:16:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:50.984646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11a30-244f-4940-973a-0971ab81e984 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:50.986703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-33d11a30-244f-4940-973a-0971ab81e984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:51.001032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11a30-244f-4940-973a-0971ab81e984 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:51.004960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89a746-bf76-44bf-8066-d5d9e781f6ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:51.005622 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a746-bf76-44bf-8066-d5d9e781f6ee service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:51.005912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a746-bf76-44bf-8066-d5d9e781f6ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:51.006190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a746-bf76-44bf-8066-d5d9e781f6ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:51.018624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89a746-bf76-44bf-8066-d5d9e781f6ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:51.020311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89a746-bf76-44bf-8066-d5d9e781f6ee service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:51.030498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1216/2447] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:51.135337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180135-71ca-4f15-8875-f027b7f11305 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:51.135639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180135-71ca-4f15-8875-f027b7f11305 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:51.135928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180135-71ca-4f15-8875-f027b7f11305 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:51.138592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1232/2448] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:16:51.147724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc148fb-710b-47bd-9721-5409e4b5f0dd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:51.149134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc148fb-710b-47bd-9721-5409e4b5f0dd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:51.149434 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc148fb-710b-47bd-9721-5409e4b5f0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:51.172987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8cc148fb-710b-47bd-9721-5409e4b5f0dd None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:51.174839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8cc148fb-710b-47bd-9721-5409e4b5f0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:51.188191 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1217/2449] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:16:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:16:51.198654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc180135-71ca-4f15-8875-f027b7f11305 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:51.215495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc180135-71ca-4f15-8875-f027b7f11305 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:51.221559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b11ce7-3623-4048-ae5e-1fabd98a7730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:51.222281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b11ce7-3623-4048-ae5e-1fabd98a7730 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:51.223060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b11ce7-3623-4048-ae5e-1fabd98a7730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:51.223060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b11ce7-3623-4048-ae5e-1fabd98a7730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:51.238034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b11ce7-3623-4048-ae5e-1fabd98a7730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:51.239846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b11ce7-3623-4048-ae5e-1fabd98a7730 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:51.252900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1233/2450] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:52.836564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e2e69-a5a3-4f92-87da-90273ea00aee None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:52.837060 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e2e69-a5a3-4f92-87da-90273ea00aee None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:52.837208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e2e69-a5a3-4f92-87da-90273ea00aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:52.864502 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-702e2e69-a5a3-4f92-87da-90273ea00aee None None] MFA Rules not processed for user `57bd74ac650548ffae959ed97034c059`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:52.865741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-702e2e69-a5a3-4f92-87da-90273ea00aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:52.878051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:52.940055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1218/2451] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:16:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:52.941199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b11ce7-3623-4048-ae5e-1fabd98a7730 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:52.952284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b11ce7-3623-4048-ae5e-1fabd98a7730 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:52.956887 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0439f-fdff-45fe-8c33-3d8c0063bf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:52.957536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0439f-fdff-45fe-8c33-3d8c0063bf23 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:52.957819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0439f-fdff-45fe-8c33-3d8c0063bf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:52.958093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0439f-fdff-45fe-8c33-3d8c0063bf23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:52.958774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0439f-fdff-45fe-8c33-3d8c0063bf23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:52.960850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0439f-fdff-45fe-8c33-3d8c0063bf23 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:52.990729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1234/2452] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:16:52 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:16:52.991919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e2e69-a5a3-4f92-87da-90273ea00aee None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:53.003251 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e2e69-a5a3-4f92-87da-90273ea00aee None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:53.071425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc297-ce64-4b6f-a0e1-274151cbdd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:53.072395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc297-ce64-4b6f-a0e1-274151cbdd20 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:53.072395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc297-ce64-4b6f-a0e1-274151cbdd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:53.072673 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc297-ce64-4b6f-a0e1-274151cbdd20 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:53.073374 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fc297-ce64-4b6f-a0e1-274151cbdd20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:53.075600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fc297-ce64-4b6f-a0e1-274151cbdd20 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:53.102518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1219/2453] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:16:52 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:16:53.108125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0439f-fdff-45fe-8c33-3d8c0063bf23 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:53.123098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0439f-fdff-45fe-8c33-3d8c0063bf23 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:53.129109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa087f-a581-4e48-bf85-f6045995d733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:53.129867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa087f-a581-4e48-bf85-f6045995d733 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:53.130233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa087f-a581-4e48-bf85-f6045995d733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:53.130586 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa087f-a581-4e48-bf85-f6045995d733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:53.131454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa087f-a581-4e48-bf85-f6045995d733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:53.133440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa087f-a581-4e48-bf85-f6045995d733 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:53.149135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1235/2454] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:16:53.153407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc297-ce64-4b6f-a0e1-274151cbdd20 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:53.164411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc297-ce64-4b6f-a0e1-274151cbdd20 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:53.170516 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857179-b28a-41c9-93ee-765aa4e24df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:53.171406 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857179-b28a-41c9-93ee-765aa4e24df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:53.171698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857179-b28a-41c9-93ee-765aa4e24df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:53.171981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857179-b28a-41c9-93ee-765aa4e24df2 admin admin] PATH_INFO: `/v3/projects/8792bc5f57cb433881f8105473ec9714/users/e1d0eb925f5e46ae81e4dc10f77b8dcd/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:53.196222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f857179-b28a-41c9-93ee-765aa4e24df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8792bc5f57cb433881f8105473ec9714, user_id=e1d0eb925f5e46ae81e4dc10f77b8dcd, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:53.199523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f857179-b28a-41c9-93ee-765aa4e24df2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:53.221300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1220/2455] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:16:53 2022] PUT /identity/v3/projects/8792bc5f57cb433881f8105473ec9714/users/e1d0eb925f5e46ae81e4dc10f77b8dcd/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:16:53.224418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa087f-a581-4e48-bf85-f6045995d733 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:53.229707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:53.242167 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa087f-a581-4e48-bf85-f6045995d733 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:53.336054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad16ff6-3114-49ff-9fe5-bb61cf12f3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:53.336789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16ff6-3114-49ff-9fe5-bb61cf12f3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:53.337076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16ff6-3114-49ff-9fe5-bb61cf12f3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:53.337354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16ff6-3114-49ff-9fe5-bb61cf12f3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:53.338100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad16ff6-3114-49ff-9fe5-bb61cf12f3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:53.340426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad16ff6-3114-49ff-9fe5-bb61cf12f3dd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:53.351201 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1236/2456] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:16:53.356309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857179-b28a-41c9-93ee-765aa4e24df2 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:53.367710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857179-b28a-41c9-93ee-765aa4e24df2 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:53.373994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1df4f-89a2-4216-a8a4-805b2b04497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:53.374934 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1df4f-89a2-4216-a8a4-805b2b04497d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:53.375216 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1df4f-89a2-4216-a8a4-805b2b04497d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:53.375490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1df4f-89a2-4216-a8a4-805b2b04497d admin admin] PATH_INFO: `/v3/projects/8792bc5f57cb433881f8105473ec9714/users/e1d0eb925f5e46ae81e4dc10f77b8dcd/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:53.377778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1df4f-89a2-4216-a8a4-805b2b04497d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8792bc5f57cb433881f8105473ec9714, user_id=e1d0eb925f5e46ae81e4dc10f77b8dcd, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:53.380553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1df4f-89a2-4216-a8a4-805b2b04497d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:53.397233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1221/2457] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:16:53 2022] PUT /identity/v3/projects/8792bc5f57cb433881f8105473ec9714/users/e1d0eb925f5e46ae81e4dc10f77b8dcd/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:16:54.309379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668669e5-4388-440d-9721-f68975349ceb None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:54.309947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668669e5-4388-440d-9721-f68975349ceb None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:54.310046 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668669e5-4388-440d-9721-f68975349ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:54.333372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-668669e5-4388-440d-9721-f68975349ceb None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:54.334742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-668669e5-4388-440d-9721-f68975349ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:54.417674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1237/2458] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:16:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:16:54.434226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1df4f-89a2-4216-a8a4-805b2b04497d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:54.436670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-29b1df4f-89a2-4216-a8a4-805b2b04497d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:54.575168 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1df4f-89a2-4216-a8a4-805b2b04497d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:54.583580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88a334-4583-4575-85b9-861821945b51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:54.584409 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88a334-4583-4575-85b9-861821945b51 service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:54.585080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88a334-4583-4575-85b9-861821945b51 service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:54.585575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88a334-4583-4575-85b9-861821945b51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:54.601003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:54.603972 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88a334-4583-4575-85b9-861821945b51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:54.606554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88a334-4583-4575-85b9-861821945b51 service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:54.617432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1222/2459] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:16:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 06:17:00.276336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15d402-40fe-4059-9221-8016ae66458e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:00.277361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15d402-40fe-4059-9221-8016ae66458e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:00.277647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15d402-40fe-4059-9221-8016ae66458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:00.366596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-dd15d402-40fe-4059-9221-8016ae66458e None None] MFA Rules not processed for user `e1d0eb925f5e46ae81e4dc10f77b8dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:00.368078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-dd15d402-40fe-4059-9221-8016ae66458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:00.461261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1238/2460] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:17:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:00.475236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88a334-4583-4575-85b9-861821945b51 service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:00.476670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-bf88a334-4583-4575-85b9-861821945b51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:00.638363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88a334-4583-4575-85b9-861821945b51 service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:00.643952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fa880-4f8d-4e9e-b772-04ac0c50269a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:00.644630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa880-4f8d-4e9e-b772-04ac0c50269a service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:00.644940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa880-4f8d-4e9e-b772-04ac0c50269a service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:00.646096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa880-4f8d-4e9e-b772-04ac0c50269a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:00.735304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fa880-4f8d-4e9e-b772-04ac0c50269a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:00.736956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fa880-4f8d-4e9e-b772-04ac0c50269a service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:00.747242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1223/2461] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:02.057323 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82339cb9-0423-4a8e-86aa-4e1be00c80bc None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.057906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82339cb9-0423-4a8e-86aa-4e1be00c80bc None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.057906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82339cb9-0423-4a8e-86aa-4e1be00c80bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.091421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-82339cb9-0423-4a8e-86aa-4e1be00c80bc None None] MFA Rules not processed for user `57bd74ac650548ffae959ed97034c059`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:02.092896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-82339cb9-0423-4a8e-86aa-4e1be00c80bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:02.100329 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1239/2462] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:17:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:10.742224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=58 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:12.085535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:22.244988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c0bd-050d-4cfb-913f-94a1a869946d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:22.245451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c0bd-050d-4cfb-913f-94a1a869946d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:22.245557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c0bd-050d-4cfb-913f-94a1a869946d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:22.263849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-06f1c0bd-050d-4cfb-913f-94a1a869946d None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:22.265108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-06f1c0bd-050d-4cfb-913f-94a1a869946d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:22.272547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1224/2463] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jun 20 06:17:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:22.285046 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82339cb9-0423-4a8e-86aa-4e1be00c80bc None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:22.298229 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82339cb9-0423-4a8e-86aa-4e1be00c80bc None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:22.303272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf639f6-ed36-403a-a0a2-6d259efa4bb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:22.303922 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf639f6-ed36-403a-a0a2-6d259efa4bb1 service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:22.304209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf639f6-ed36-403a-a0a2-6d259efa4bb1 service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:22.304489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf639f6-ed36-403a-a0a2-6d259efa4bb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:22.313761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf639f6-ed36-403a-a0a2-6d259efa4bb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:22.315353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf639f6-ed36-403a-a0a2-6d259efa4bb1 service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:22.323641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1240/2464] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:17:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:17:32.258725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:32.320284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:37.498236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1c0bd-050d-4cfb-913f-94a1a869946d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:37.552261 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1c0bd-050d-4cfb-913f-94a1a869946d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:37.555830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477a87-15d6-4bc5-8f67-ab8b57b9181c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:37.556468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477a87-15d6-4bc5-8f67-ab8b57b9181c service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:37.556800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477a87-15d6-4bc5-8f67-ab8b57b9181c service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:37.557076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477a87-15d6-4bc5-8f67-ab8b57b9181c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:37.566413 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00477a87-15d6-4bc5-8f67-ab8b57b9181c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:37.567837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00477a87-15d6-4bc5-8f67-ab8b57b9181c service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:37.577674 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1225/2465] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:47.573099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=26 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:13.786289 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf639f6-ed36-403a-a0a2-6d259efa4bb1 service swift] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:13.796646 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf639f6-ed36-403a-a0a2-6d259efa4bb1 service swift] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:13.800302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c02052-2300-4294-8092-45c8e15344dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:13.800978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c02052-2300-4294-8092-45c8e15344dd service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:13.801267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c02052-2300-4294-8092-45c8e15344dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:13.801549 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c02052-2300-4294-8092-45c8e15344dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:13.803331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c6c02052-2300-4294-8092-45c8e15344dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:13.816885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c02052-2300-4294-8092-45c8e15344dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:13.818345 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c02052-2300-4294-8092-45c8e15344dd service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:13.829678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1241/2466] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:13.903084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477a87-15d6-4bc5-8f67-ab8b57b9181c service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:13.912432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477a87-15d6-4bc5-8f67-ab8b57b9181c service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:13.916647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb91ca9-79f3-4693-887b-d2838643524a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:13.917307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb91ca9-79f3-4693-887b-d2838643524a service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:13.917600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb91ca9-79f3-4693-887b-d2838643524a service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:13.917889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb91ca9-79f3-4693-887b-d2838643524a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:13.919680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-adb91ca9-79f3-4693-887b-d2838643524a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:13.934207 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb91ca9-79f3-4693-887b-d2838643524a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:13.935383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb91ca9-79f3-4693-887b-d2838643524a service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:13.947179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1226/2467] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:23.824482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:23.942671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:26.648811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c02052-2300-4294-8092-45c8e15344dd service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:26.650217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c6c02052-2300-4294-8092-45c8e15344dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:26.664326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c02052-2300-4294-8092-45c8e15344dd service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:26.669976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a181e5-5e88-4b66-8b82-3eb86ae438bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:26.670623 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a181e5-5e88-4b66-8b82-3eb86ae438bd service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:26.671573 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a181e5-5e88-4b66-8b82-3eb86ae438bd service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:26.671943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a181e5-5e88-4b66-8b82-3eb86ae438bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:26.673846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-48a181e5-5e88-4b66-8b82-3eb86ae438bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:26.734813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a181e5-5e88-4b66-8b82-3eb86ae438bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:26.736410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a181e5-5e88-4b66-8b82-3eb86ae438bd service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:26.745766 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1242/2468] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:30.148480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb91ca9-79f3-4693-887b-d2838643524a service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:30.160073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb91ca9-79f3-4693-887b-d2838643524a service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:30.166320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfb359-5acd-4f6b-8562-69b938e76b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:30.166963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb359-5acd-4f6b-8562-69b938e76b44 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:30.167245 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb359-5acd-4f6b-8562-69b938e76b44 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:30.167520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb359-5acd-4f6b-8562-69b938e76b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:30.169300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-30dfb359-5acd-4f6b-8562-69b938e76b44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:30.230317 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfb359-5acd-4f6b-8562-69b938e76b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:30.231906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfb359-5acd-4f6b-8562-69b938e76b44 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:30.241798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1227/2469] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:34.041683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1753b7-4fb6-4a8d-9080-a7606ff78c49 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:34.042594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1753b7-4fb6-4a8d-9080-a7606ff78c49 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:34.043085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1753b7-4fb6-4a8d-9080-a7606ff78c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:34.062261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-6e1753b7-4fb6-4a8d-9080-a7606ff78c49 None None] MFA Rules not processed for user `c17483c734a6435ea9599f15cab4a559`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:34.063927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6e1753b7-4fb6-4a8d-9080-a7606ff78c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:34.071253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1243/2470] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:18:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:34.948471 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfb359-5acd-4f6b-8562-69b938e76b44 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:34.960943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfb359-5acd-4f6b-8562-69b938e76b44 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:34.967174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ae4ae-e5e6-4268-bda8-5a4f87707ffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:34.968136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae4ae-e5e6-4268-bda8-5a4f87707ffa service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:34.968670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae4ae-e5e6-4268-bda8-5a4f87707ffa service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:34.969187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae4ae-e5e6-4268-bda8-5a4f87707ffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:34.971334 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-428ae4ae-e5e6-4268-bda8-5a4f87707ffa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:35.042317 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ae4ae-e5e6-4268-bda8-5a4f87707ffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:35.045463 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ae4ae-e5e6-4268-bda8-5a4f87707ffa service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:35.060955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1228/2471] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:43.411013 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1753b7-4fb6-4a8d-9080-a7606ff78c49 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:43.421111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1753b7-4fb6-4a8d-9080-a7606ff78c49 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:43.425257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b612ae-f870-41b1-9eaf-cee1c21fd6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:43.425930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b612ae-f870-41b1-9eaf-cee1c21fd6ef service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:43.426225 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b612ae-f870-41b1-9eaf-cee1c21fd6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:43.426538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b612ae-f870-41b1-9eaf-cee1c21fd6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:43.428415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b2b612ae-f870-41b1-9eaf-cee1c21fd6ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:43.439194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b612ae-f870-41b1-9eaf-cee1c21fd6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:43.441750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b612ae-f870-41b1-9eaf-cee1c21fd6ef service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:43.455130 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1244/2472] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:45.052972 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=56 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:47.426506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71371ea-ab77-4b06-b63d-4d44ece7915e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:47.427123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71371ea-ab77-4b06-b63d-4d44ece7915e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:47.427123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71371ea-ab77-4b06-b63d-4d44ece7915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:47.444690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b71371ea-ab77-4b06-b63d-4d44ece7915e None None] MFA Rules not processed for user `c9ea06c7648041d88aff6e58afcb8219`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:47.445890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b71371ea-ab77-4b06-b63d-4d44ece7915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:47.454591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1229/2473] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:18:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:47.831602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b612ae-f870-41b1-9eaf-cee1c21fd6ef service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:47.841681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b612ae-f870-41b1-9eaf-cee1c21fd6ef service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:47.845701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f41a8-a9d8-4638-a702-83ed67d15ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:47.846373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f41a8-a9d8-4638-a702-83ed67d15ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:47.846684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f41a8-a9d8-4638-a702-83ed67d15ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:47.846979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f41a8-a9d8-4638-a702-83ed67d15ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:47.848994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1c5f41a8-a9d8-4638-a702-83ed67d15ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:47.860051 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f41a8-a9d8-4638-a702-83ed67d15ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:47.861533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f41a8-a9d8-4638-a702-83ed67d15ad1 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:47.869869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1245/2474] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:48.188111 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71371ea-ab77-4b06-b63d-4d44ece7915e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:18:48.190656 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b71371ea-ab77-4b06-b63d-4d44ece7915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:48.273370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71371ea-ab77-4b06-b63d-4d44ece7915e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:18:48.278603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fe083-a051-4684-9eb6-d62bbfbb8db3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:18:48.279000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fe083-a051-4684-9eb6-d62bbfbb8db3 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:48.279284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fe083-a051-4684-9eb6-d62bbfbb8db3 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:48.279560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fe083-a051-4684-9eb6-d62bbfbb8db3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:48.282626 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cc9fe083-a051-4684-9eb6-d62bbfbb8db3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:48.297806 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fe083-a051-4684-9eb6-d62bbfbb8db3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:18:48.299288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fe083-a051-4684-9eb6-d62bbfbb8db3 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:18:48.310161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1230/2475] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:18:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:18:48.712502 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e893e0-9627-4ec5-8a1b-62f664f74423 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:18:48.712832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e893e0-9627-4ec5-8a1b-62f664f74423 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:18:48.713122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e893e0-9627-4ec5-8a1b-62f664f74423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:18:48.734552 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-c8e893e0-9627-4ec5-8a1b-62f664f74423 None None] MFA Rules not processed for user `21d8d5c8b45d4d15a60a66b955dc9617`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:18:48.736096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c8e893e0-9627-4ec5-8a1b-62f664f74423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:18:48.743108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1246/2476] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:18:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:18:58.306121 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=35 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:58.729295 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=46 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:01.516512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fe083-a051-4684-9eb6-d62bbfbb8db3 service placement] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:01.529122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fe083-a051-4684-9eb6-d62bbfbb8db3 service placement] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:01.536678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e9158-95f6-4441-986b-95acc24831e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:01.537347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e9158-95f6-4441-986b-95acc24831e4 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:01.537747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e9158-95f6-4441-986b-95acc24831e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:01.538031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e9158-95f6-4441-986b-95acc24831e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:01.540108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-343e9158-95f6-4441-986b-95acc24831e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:01.555295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e9158-95f6-4441-986b-95acc24831e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:01.556890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e9158-95f6-4441-986b-95acc24831e4 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:01.568498 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1231/2477] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:05.830557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e893e0-9627-4ec5-8a1b-62f664f74423 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:05.844314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e893e0-9627-4ec5-8a1b-62f664f74423 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:05.850234 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ab4ea-deb8-42bd-97ae-758a685e3dbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:05.850957 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab4ea-deb8-42bd-97ae-758a685e3dbb service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:05.851254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab4ea-deb8-42bd-97ae-758a685e3dbb service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:05.851536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab4ea-deb8-42bd-97ae-758a685e3dbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:05.853343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e89ab4ea-deb8-42bd-97ae-758a685e3dbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:05.866014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ab4ea-deb8-42bd-97ae-758a685e3dbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:05.867627 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ab4ea-deb8-42bd-97ae-758a685e3dbb service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:05.878454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1247/2478] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:11.563485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:15.873869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:30.133523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeead49c-762d-4ac1-8698-e141f3b7e15f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:30.133980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeead49c-762d-4ac1-8698-e141f3b7e15f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:30.134123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeead49c-762d-4ac1-8698-e141f3b7e15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:30.153034 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-eeead49c-762d-4ac1-8698-e141f3b7e15f None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:19:30.154234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-eeead49c-762d-4ac1-8698-e141f3b7e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:30.161414 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1232/2479] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jun 20 06:19:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:19:30.209688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ab4ea-deb8-42bd-97ae-758a685e3dbb service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:30.221113 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ab4ea-deb8-42bd-97ae-758a685e3dbb service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:30.226307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496edb3-db00-4d6c-a521-febdaafa075e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:30.226947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496edb3-db00-4d6c-a521-febdaafa075e service swift] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:30.227236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496edb3-db00-4d6c-a521-febdaafa075e service swift] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:30.227516 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496edb3-db00-4d6c-a521-febdaafa075e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:30.235598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496edb3-db00-4d6c-a521-febdaafa075e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:30.237769 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496edb3-db00-4d6c-a521-febdaafa075e service swift] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:30.245974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1248/2480] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:19:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:19:37.046068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeead49c-762d-4ac1-8698-e141f3b7e15f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.058506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeead49c-762d-4ac1-8698-e141f3b7e15f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.064088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455d30a-34b1-4768-b0fb-b3d76a2e9491 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.064766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455d30a-34b1-4768-b0fb-b3d76a2e9491 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.065591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455d30a-34b1-4768-b0fb-b3d76a2e9491 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.065874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455d30a-34b1-4768-b0fb-b3d76a2e9491 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.067686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6455d30a-34b1-4768-b0fb-b3d76a2e9491 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:37.079660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455d30a-34b1-4768-b0fb-b3d76a2e9491 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.081875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455d30a-34b1-4768-b0fb-b3d76a2e9491 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.092506 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1233/2481] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:37.123629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496edb3-db00-4d6c-a521-febdaafa075e service swift] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.125503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-6496edb3-db00-4d6c-a521-febdaafa075e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:37.195246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496edb3-db00-4d6c-a521-febdaafa075e service swift] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.199774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.200681 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.200975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.201263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] PATH_INFO: `/v3/users/6734724f68514b3190569f02e3d08ddb` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.202462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6734724f68514b3190569f02e3d08ddb)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.204389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.249068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6734724f68514b3190569f02e3d08ddb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.256603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6734724f68514b3190569f02e3d08ddb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.257301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6734724f68514b3190569f02e3d08ddb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.257908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6734724f68514b3190569f02e3d08ddb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.270264 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6734724f68514b3190569f02e3d08ddb'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.282929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1249/2482] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:19:37 2022] DELETE /identity/v3/users/6734724f68514b3190569f02e3d08ddb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:37.459592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455d30a-34b1-4768-b0fb-b3d76a2e9491 service placement] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.474731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455d30a-34b1-4768-b0fb-b3d76a2e9491 service placement] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.536126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.537080 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.537316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.537604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] PATH_INFO: `/v3/projects/608837ccca4d4c34a32702e95a25aba0` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.538796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608837ccca4d4c34a32702e95a25aba0)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.541019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.586957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608837ccca4d4c34a32702e95a25aba0', 'request_id': 'req-337b08b1-f799-42a6-a993-e1394f148fa5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.592977 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608837ccca4d4c34a32702e95a25aba0', 'request_id': 'req-337b08b1-f799-42a6-a993-e1394f148fa5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.599123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608837ccca4d4c34a32702e95a25aba0', 'request_id': 'req-337b08b1-f799-42a6-a993-e1394f148fa5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.611098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] The token cache is being invalidate because project 608837ccca4d4c34a32702e95a25aba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:19:37.611387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.612049 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.613611 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1234/2483] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:19:37 2022] DELETE /identity/v3/projects/608837ccca4d4c34a32702e95a25aba0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:37.617546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.618964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:37.632328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a24c-302e-4d06-9706-f1d6f55f993e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:37.688655 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:37.689539 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:37.689860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:37.690151 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] PATH_INFO: `/v3/users/fa678395766c4e10ba7d079ae00c1448` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:37.691347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa678395766c4e10ba7d079ae00c1448)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:37.693327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:37.698658 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:37.742786 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa678395766c4e10ba7d079ae00c1448'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.749725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa678395766c4e10ba7d079ae00c1448'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.750425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa678395766c4e10ba7d079ae00c1448'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.751038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa678395766c4e10ba7d079ae00c1448'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.763108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa678395766c4e10ba7d079ae00c1448'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:37.775970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1250/2484] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:19:37 2022] DELETE /identity/v3/users/fa678395766c4e10ba7d079ae00c1448 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:37.948218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:37.949721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:37.966899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b08b1-f799-42a6-a993-e1394f148fa5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:38.024787 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:38.025654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:38.025945 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:38.026227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] PATH_INFO: `/v3/projects/024c139199e946c68fa5241b5c978da8` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:38.027488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=024c139199e946c68fa5241b5c978da8)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:38.029682 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:38.044819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:38.082902 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024c139199e946c68fa5241b5c978da8', 'request_id': 'req-ad99c94b-4e51-4280-b2df-fb803e0af4d5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:38.089634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024c139199e946c68fa5241b5c978da8', 'request_id': 'req-ad99c94b-4e51-4280-b2df-fb803e0af4d5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:38.095102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024c139199e946c68fa5241b5c978da8', 'request_id': 'req-ad99c94b-4e51-4280-b2df-fb803e0af4d5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:38.107312 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] The token cache is being invalidate because project 024c139199e946c68fa5241b5c978da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:19:38.107602 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:38.108223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:38.109808 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1235/2485] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:19:37 2022] DELETE /identity/v3/projects/024c139199e946c68fa5241b5c978da8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:19:47.772484 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:48.104232 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:56.317272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:56.318844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:56.376566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a54086-313f-4fc4-8b26-1d41ff9c4066 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:56.424697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f879d06-3263-49bd-9d67-a5c218045f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:56.425341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879d06-3263-49bd-9d67-a5c218045f3d service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:56.425628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879d06-3263-49bd-9d67-a5c218045f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:56.425912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879d06-3263-49bd-9d67-a5c218045f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:56.427706 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1f879d06-3263-49bd-9d67-a5c218045f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:56.491345 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f879d06-3263-49bd-9d67-a5c218045f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:56.492844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f879d06-3263-49bd-9d67-a5c218045f3d service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:56.502909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1251/2486] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:19:59.589778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:59.589778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:19:59.601276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c94b-4e51-4280-b2df-fb803e0af4d5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:59.606413 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa8717-42e6-41f6-b4e9-d0df82dc9e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:59.607373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa8717-42e6-41f6-b4e9-d0df82dc9e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:59.607664 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa8717-42e6-41f6-b4e9-d0df82dc9e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:59.607984 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa8717-42e6-41f6-b4e9-d0df82dc9e57 admin admin] PATH_INFO: `/v3/users/c17483c734a6435ea9599f15cab4a559` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:59.609322 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa8717-42e6-41f6-b4e9-d0df82dc9e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17483c734a6435ea9599f15cab4a559)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:59.611212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa8717-42e6-41f6-b4e9-d0df82dc9e57 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:59.663316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-66fa8717-42e6-41f6-b4e9-d0df82dc9e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17483c734a6435ea9599f15cab4a559'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.670658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-66fa8717-42e6-41f6-b4e9-d0df82dc9e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17483c734a6435ea9599f15cab4a559'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.671270 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-66fa8717-42e6-41f6-b4e9-d0df82dc9e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17483c734a6435ea9599f15cab4a559'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.671879 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-66fa8717-42e6-41f6-b4e9-d0df82dc9e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17483c734a6435ea9599f15cab4a559'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.683581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-66fa8717-42e6-41f6-b4e9-d0df82dc9e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17483c734a6435ea9599f15cab4a559'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:19:59.695720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1236/2487] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:19:59 2022] DELETE /identity/v3/users/c17483c734a6435ea9599f15cab4a559 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:19:59.868537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f879d06-3263-49bd-9d67-a5c218045f3d service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:19:59.879047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f879d06-3263-49bd-9d67-a5c218045f3d service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:19:59.942176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:19:59.943065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:19:59.943350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:19:59.943634 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] PATH_INFO: `/v3/projects/d52c906800e74c5f8b743ce98eb6372b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:19:59.944875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52c906800e74c5f8b743ce98eb6372b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:19:59.946830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:19:59.954884 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:59.994278 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52c906800e74c5f8b743ce98eb6372b', 'request_id': 'req-9acde444-c9ff-4dfc-b86f-003fcc15938b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.000478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52c906800e74c5f8b743ce98eb6372b', 'request_id': 'req-9acde444-c9ff-4dfc-b86f-003fcc15938b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.008550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52c906800e74c5f8b743ce98eb6372b', 'request_id': 'req-9acde444-c9ff-4dfc-b86f-003fcc15938b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.019502 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] The token cache is being invalidate because project d52c906800e74c5f8b743ce98eb6372b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:00.019791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.020411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9acde444-c9ff-4dfc-b86f-003fcc15938b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:00.021969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1252/2488] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:19:59 2022] DELETE /identity/v3/projects/d52c906800e74c5f8b743ce98eb6372b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:00.026945 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc7507-9f24-40cf-a9bc-f4d7f761379c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.027309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc7507-9f24-40cf-a9bc-f4d7f761379c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.027593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc7507-9f24-40cf-a9bc-f4d7f761379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.045512 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8cfc7507-9f24-40cf-a9bc-f4d7f761379c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:00.046696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8cfc7507-9f24-40cf-a9bc-f4d7f761379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:00.106320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1237/2489] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:00.113998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc772a-076f-4e96-9c4b-c7bcccd24ce6 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.114248 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc772a-076f-4e96-9c4b-c7bcccd24ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.114495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc772a-076f-4e96-9c4b-c7bcccd24ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.133585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-a1fc772a-076f-4e96-9c4b-c7bcccd24ce6 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:00.134791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a1fc772a-076f-4e96-9c4b-c7bcccd24ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:00.142728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1253/2490] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:00.147648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc7507-9f24-40cf-a9bc-f4d7f761379c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.157360 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc7507-9f24-40cf-a9bc-f4d7f761379c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.162081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6a0b-633e-4882-aeff-c27bc1829773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.162731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6a0b-633e-4882-aeff-c27bc1829773 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.163017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6a0b-633e-4882-aeff-c27bc1829773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.163297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6a0b-633e-4882-aeff-c27bc1829773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.164019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6a0b-633e-4882-aeff-c27bc1829773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:00.164330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6a0b-633e-4882-aeff-c27bc1829773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.166234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6a0b-633e-4882-aeff-c27bc1829773 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.177658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1238/2491] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:00.181747 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc772a-076f-4e96-9c4b-c7bcccd24ce6 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.191797 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc772a-076f-4e96-9c4b-c7bcccd24ce6 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.196510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874c74e-3558-4249-8b7b-12ab3aec7556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.198841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874c74e-3558-4249-8b7b-12ab3aec7556 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.198841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874c74e-3558-4249-8b7b-12ab3aec7556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.198841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874c74e-3558-4249-8b7b-12ab3aec7556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.198841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874c74e-3558-4249-8b7b-12ab3aec7556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.200419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874c74e-3558-4249-8b7b-12ab3aec7556 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.238411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1254/2492] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/projects => generated 403 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:00.242645 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6a0b-633e-4882-aeff-c27bc1829773 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.253110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6a0b-633e-4882-aeff-c27bc1829773 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.309013 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dc973-7566-4d4e-8bec-b8bb46fb5f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.309692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc973-7566-4d4e-8bec-b8bb46fb5f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.309983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc973-7566-4d4e-8bec-b8bb46fb5f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.310266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc973-7566-4d4e-8bec-b8bb46fb5f20 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.310974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dc973-7566-4d4e-8bec-b8bb46fb5f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.312923 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dc973-7566-4d4e-8bec-b8bb46fb5f20 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.320277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:00.341037 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1239/2493] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:00.345120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874c74e-3558-4249-8b7b-12ab3aec7556 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.356545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874c74e-3558-4249-8b7b-12ab3aec7556 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.361285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d71d-909f-4e16-b652-c30996037991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.361993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d71d-909f-4e16-b652-c30996037991 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.362366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d71d-909f-4e16-b652-c30996037991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.362654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d71d-909f-4e16-b652-c30996037991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.363469 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1d71d-909f-4e16-b652-c30996037991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.365100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1d71d-909f-4e16-b652-c30996037991 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.379964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1255/2494] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:00.381546 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dc973-7566-4d4e-8bec-b8bb46fb5f20 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.391652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dc973-7566-4d4e-8bec-b8bb46fb5f20 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.397570 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb6816-c4b4-4e18-9830-c5857739c4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.398236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6816-c4b4-4e18-9830-c5857739c4fc admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.398526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6816-c4b4-4e18-9830-c5857739c4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.398855 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6816-c4b4-4e18-9830-c5857739c4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.399583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb6816-c4b4-4e18-9830-c5857739c4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.401508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb6816-c4b4-4e18-9830-c5857739c4fc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.412711 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1240/2495] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:00.417092 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d71d-909f-4e16-b652-c30996037991 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.428553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d71d-909f-4e16-b652-c30996037991 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.433303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c98b0-0380-4266-9881-efcb101c183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.434254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c98b0-0380-4266-9881-efcb101c183e admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.434601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c98b0-0380-4266-9881-efcb101c183e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.434942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c98b0-0380-4266-9881-efcb101c183e admin admin] PATH_INFO: `/v3/projects/56575501213c4383b447d3168a1a94f8/users/d053169f206e4f4bb6dbbd0612156fcc/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.451887 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c98b0-0380-4266-9881-efcb101c183e admin admin] RBAC: Authorizing `identity:create_grant(project_id=56575501213c4383b447d3168a1a94f8, user_id=d053169f206e4f4bb6dbbd0612156fcc, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.454625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c98b0-0380-4266-9881-efcb101c183e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.467237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1256/2496] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:00 2022] PUT /identity/v3/projects/56575501213c4383b447d3168a1a94f8/users/d053169f206e4f4bb6dbbd0612156fcc/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:00.477309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7bbc-b6cf-49ca-84c0-071183f4dfb5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.477589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7bbc-b6cf-49ca-84c0-071183f4dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.477874 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7bbc-b6cf-49ca-84c0-071183f4dfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.505139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-478d7bbc-b6cf-49ca-84c0-071183f4dfb5 None None] MFA Rules not processed for user `d053169f206e4f4bb6dbbd0612156fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:00.506363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-478d7bbc-b6cf-49ca-84c0-071183f4dfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:00.569769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1241/2497] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:00.574155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c98b0-0380-4266-9881-efcb101c183e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.637701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c98b0-0380-4266-9881-efcb101c183e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.642410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b114d0-546b-4671-abd7-37d54e043827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.643837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b114d0-546b-4671-abd7-37d54e043827 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.644117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b114d0-546b-4671-abd7-37d54e043827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.644399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b114d0-546b-4671-abd7-37d54e043827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.645134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b114d0-546b-4671-abd7-37d54e043827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.647045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b114d0-546b-4671-abd7-37d54e043827 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.672987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1257/2498] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:00.678307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d7bbc-b6cf-49ca-84c0-071183f4dfb5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.688981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d7bbc-b6cf-49ca-84c0-071183f4dfb5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.745349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e9002-3411-48ad-abcd-8470c44dc264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.746018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e9002-3411-48ad-abcd-8470c44dc264 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.746308 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e9002-3411-48ad-abcd-8470c44dc264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.746588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e9002-3411-48ad-abcd-8470c44dc264 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.747330 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e9002-3411-48ad-abcd-8470c44dc264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.749274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e9002-3411-48ad-abcd-8470c44dc264 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.773644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1242/2499] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:00.777628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b114d0-546b-4671-abd7-37d54e043827 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.788937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b114d0-546b-4671-abd7-37d54e043827 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.793909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630132fc-3166-4c45-bd86-917cb16fb295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.794574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630132fc-3166-4c45-bd86-917cb16fb295 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.794864 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630132fc-3166-4c45-bd86-917cb16fb295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.795149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630132fc-3166-4c45-bd86-917cb16fb295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.795916 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630132fc-3166-4c45-bd86-917cb16fb295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.797576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630132fc-3166-4c45-bd86-917cb16fb295 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.800059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:00.810767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1258/2500] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:00.815094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e9002-3411-48ad-abcd-8470c44dc264 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.825252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e9002-3411-48ad-abcd-8470c44dc264 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.829849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddcd65-d532-4cfa-91be-8ed7a0af40e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.831340 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddcd65-d532-4cfa-91be-8ed7a0af40e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.831627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddcd65-d532-4cfa-91be-8ed7a0af40e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.831908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddcd65-d532-4cfa-91be-8ed7a0af40e7 admin admin] PATH_INFO: `/v3/projects/bb20b2d2264349e0a7dde01925c4c9bd/users/417203292780484f879db0e7e968d32e/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.846376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddcd65-d532-4cfa-91be-8ed7a0af40e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb20b2d2264349e0a7dde01925c4c9bd, user_id=417203292780484f879db0e7e968d32e, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.849091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddcd65-d532-4cfa-91be-8ed7a0af40e7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.861437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1243/2501] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:00 2022] PUT /identity/v3/projects/bb20b2d2264349e0a7dde01925c4c9bd/users/417203292780484f879db0e7e968d32e/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:00.865867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630132fc-3166-4c45-bd86-917cb16fb295 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.876043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630132fc-3166-4c45-bd86-917cb16fb295 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.933337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9e602-a715-4633-8e1c-b7d8b2af04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.934010 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9e602-a715-4633-8e1c-b7d8b2af04a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.934301 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9e602-a715-4633-8e1c-b7d8b2af04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.934582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9e602-a715-4633-8e1c-b7d8b2af04a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.935312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9e602-a715-4633-8e1c-b7d8b2af04a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.936975 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9e602-a715-4633-8e1c-b7d8b2af04a7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.947265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1259/2502] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:00.951555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddcd65-d532-4cfa-91be-8ed7a0af40e7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:00.965524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddcd65-d532-4cfa-91be-8ed7a0af40e7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:00.970287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57802081-d63f-443a-b1d4-b525011ebf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:00.971209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57802081-d63f-443a-b1d4-b525011ebf31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.971493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57802081-d63f-443a-b1d4-b525011ebf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.971774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57802081-d63f-443a-b1d4-b525011ebf31 admin admin] PATH_INFO: `/v3/projects/bb20b2d2264349e0a7dde01925c4c9bd/users/417203292780484f879db0e7e968d32e/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:00.973792 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57802081-d63f-443a-b1d4-b525011ebf31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb20b2d2264349e0a7dde01925c4c9bd, user_id=417203292780484f879db0e7e968d32e, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:00.976487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57802081-d63f-443a-b1d4-b525011ebf31 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:00.986818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1244/2503] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:00 2022] PUT /identity/v3/projects/bb20b2d2264349e0a7dde01925c4c9bd/users/417203292780484f879db0e7e968d32e/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:00.998091 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4272-46f3-48a9-ab82-8f838cbb200a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:00.998391 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4272-46f3-48a9-ab82-8f838cbb200a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:00.998676 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4272-46f3-48a9-ab82-8f838cbb200a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.026745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-378f4272-46f3-48a9-ab82-8f838cbb200a None None] MFA Rules not processed for user `417203292780484f879db0e7e968d32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:01.027996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-378f4272-46f3-48a9-ab82-8f838cbb200a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:01.095285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1260/2504] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:01.106024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57802081-d63f-443a-b1d4-b525011ebf31 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:01.107736 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-57802081-d63f-443a-b1d4-b525011ebf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:01.132122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:01.169340 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57802081-d63f-443a-b1d4-b525011ebf31 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:01.173132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10093bee-6bd3-41f4-a9d5-2b2329c0db43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:01.173778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093bee-6bd3-41f4-a9d5-2b2329c0db43 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.174585 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093bee-6bd3-41f4-a9d5-2b2329c0db43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.174866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093bee-6bd3-41f4-a9d5-2b2329c0db43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.184028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10093bee-6bd3-41f4-a9d5-2b2329c0db43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:01.185482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10093bee-6bd3-41f4-a9d5-2b2329c0db43 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:01.195884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1245/2505] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:01 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:01.500998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f4272-46f3-48a9-ab82-8f838cbb200a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:01.563474 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f4272-46f3-48a9-ab82-8f838cbb200a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:01.568216 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:01.569109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.569393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.569667 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] PATH_INFO: `/v3/users/d053169f206e4f4bb6dbbd0612156fcc` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.570834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d053169f206e4f4bb6dbbd0612156fcc)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:01.572829 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:01.593788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:01.629502 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd053169f206e4f4bb6dbbd0612156fcc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:01.636433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd053169f206e4f4bb6dbbd0612156fcc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:01.637158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd053169f206e4f4bb6dbbd0612156fcc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:01.637757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd053169f206e4f4bb6dbbd0612156fcc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:01.649649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd053169f206e4f4bb6dbbd0612156fcc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:01.663559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1261/2506] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:01 2022] DELETE /identity/v3/users/d053169f206e4f4bb6dbbd0612156fcc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:01.668285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce841f43-10c0-4cd0-b6a1-deb57bc101b3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.668581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce841f43-10c0-4cd0-b6a1-deb57bc101b3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.668895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce841f43-10c0-4cd0-b6a1-deb57bc101b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.687018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ce841f43-10c0-4cd0-b6a1-deb57bc101b3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:01.688211 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ce841f43-10c0-4cd0-b6a1-deb57bc101b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:01.745549 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1246/2507] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:01.755380 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:01.756902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:01.815596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846bfc8-df07-4bf6-b7aa-acc319a9d22b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:01.819280 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad173dd9-1d51-4e0e-8e8c-7d017a4f9b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:01.819919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad173dd9-1d51-4e0e-8e8c-7d017a4f9b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:01.820205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad173dd9-1d51-4e0e-8e8c-7d017a4f9b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:01.820482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad173dd9-1d51-4e0e-8e8c-7d017a4f9b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:01.829489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad173dd9-1d51-4e0e-8e8c-7d017a4f9b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:01.830990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad173dd9-1d51-4e0e-8e8c-7d017a4f9b46 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:01.840287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1262/2508] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:02.102572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce841f43-10c0-4cd0-b6a1-deb57bc101b3 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:02.104033 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ce841f43-10c0-4cd0-b6a1-deb57bc101b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:02.117838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce841f43-10c0-4cd0-b6a1-deb57bc101b3 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:02.123112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:02.124164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:02.124444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:02.124853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] PATH_INFO: `/v3/projects/56575501213c4383b447d3168a1a94f8` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:02.126124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56575501213c4383b447d3168a1a94f8)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:02.128062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:02.177253 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56575501213c4383b447d3168a1a94f8', 'request_id': 'req-5faf855f-9d84-4e33-bf77-572bf0a0c449'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.183565 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56575501213c4383b447d3168a1a94f8', 'request_id': 'req-5faf855f-9d84-4e33-bf77-572bf0a0c449'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.189088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56575501213c4383b447d3168a1a94f8', 'request_id': 'req-5faf855f-9d84-4e33-bf77-572bf0a0c449'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.200908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] The token cache is being invalidate because project 56575501213c4383b447d3168a1a94f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:02.201201 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.201828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.203365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1247/2509] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:02 2022] DELETE /identity/v3/projects/56575501213c4383b447d3168a1a94f8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:02.208269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad173dd9-1d51-4e0e-8e8c-7d017a4f9b46 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:02.218109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad173dd9-1d51-4e0e-8e8c-7d017a4f9b46 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:02.275213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d285c-a644-4ca5-8f71-c4d78d38f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:02.276110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d285c-a644-4ca5-8f71-c4d78d38f1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:02.276388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d285c-a644-4ca5-8f71-c4d78d38f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:02.276687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d285c-a644-4ca5-8f71-c4d78d38f1fc admin admin] PATH_INFO: `/v3/users/417203292780484f879db0e7e968d32e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:02.277928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d285c-a644-4ca5-8f71-c4d78d38f1fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=417203292780484f879db0e7e968d32e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:02.279793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d285c-a644-4ca5-8f71-c4d78d38f1fc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:02.324566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:02.327836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-282d285c-a644-4ca5-8f71-c4d78d38f1fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417203292780484f879db0e7e968d32e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.336939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-282d285c-a644-4ca5-8f71-c4d78d38f1fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417203292780484f879db0e7e968d32e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.337606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-282d285c-a644-4ca5-8f71-c4d78d38f1fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417203292780484f879db0e7e968d32e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.338214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-282d285c-a644-4ca5-8f71-c4d78d38f1fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417203292780484f879db0e7e968d32e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.349851 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-282d285c-a644-4ca5-8f71-c4d78d38f1fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417203292780484f879db0e7e968d32e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.362125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1263/2510] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:02 2022] DELETE /identity/v3/users/417203292780484f879db0e7e968d32e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:02.637185 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:02.638659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:02.653675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf855f-9d84-4e33-bf77-572bf0a0c449 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:02.699253 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:02.714476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:02.715347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:02.715640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:02.716057 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] PATH_INFO: `/v3/projects/bb20b2d2264349e0a7dde01925c4c9bd` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:02.717295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb20b2d2264349e0a7dde01925c4c9bd)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:02.719233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:02.764019 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb20b2d2264349e0a7dde01925c4c9bd', 'request_id': 'req-ce005817-fac3-400f-8b4c-f5e17407c555'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.770615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb20b2d2264349e0a7dde01925c4c9bd', 'request_id': 'req-ce005817-fac3-400f-8b4c-f5e17407c555'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.776086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb20b2d2264349e0a7dde01925c4c9bd', 'request_id': 'req-ce005817-fac3-400f-8b4c-f5e17407c555'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.789156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] The token cache is being invalidate because project bb20b2d2264349e0a7dde01925c4c9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:02.789450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.790325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ce005817-fac3-400f-8b4c-f5e17407c555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:02.791862 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1248/2511] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:02 2022] DELETE /identity/v3/projects/bb20b2d2264349e0a7dde01925c4c9bd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:02.797060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa06c-cf24-4ec6-bf86-dd089edcf2a3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:02.797582 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa06c-cf24-4ec6-bf86-dd089edcf2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:02.798913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa06c-cf24-4ec6-bf86-dd089edcf2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:02.817298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-570fa06c-cf24-4ec6-bf86-dd089edcf2a3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:02.818418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-570fa06c-cf24-4ec6-bf86-dd089edcf2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:02.877079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1264/2512] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:02.884949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259753b2-2d6b-4af3-9538-922a8cb3027c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:02.885252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259753b2-2d6b-4af3-9538-922a8cb3027c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:02.885559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259753b2-2d6b-4af3-9538-922a8cb3027c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:02.904031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-259753b2-2d6b-4af3-9538-922a8cb3027c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:02.905267 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-259753b2-2d6b-4af3-9538-922a8cb3027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:02.913727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1249/2513] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:02.918175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fa06c-cf24-4ec6-bf86-dd089edcf2a3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:02.927849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fa06c-cf24-4ec6-bf86-dd089edcf2a3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:02.932476 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75512-e37f-4e5d-be41-d9146d69a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:02.933180 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75512-e37f-4e5d-be41-d9146d69a422 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:02.933472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75512-e37f-4e5d-be41-d9146d69a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:02.933756 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75512-e37f-4e5d-be41-d9146d69a422 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:02.934521 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f75512-e37f-4e5d-be41-d9146d69a422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:02.934836 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f75512-e37f-4e5d-be41-d9146d69a422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:02.936451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f75512-e37f-4e5d-be41-d9146d69a422 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:02.947894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1265/2514] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:02.952159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259753b2-2d6b-4af3-9538-922a8cb3027c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:02.962118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259753b2-2d6b-4af3-9538-922a8cb3027c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:02.966910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8f01a-0595-4aab-930a-990481adef47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:02.967559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f01a-0595-4aab-930a-990481adef47 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:02.967847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f01a-0595-4aab-930a-990481adef47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:02.968128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f01a-0595-4aab-930a-990481adef47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:02.968846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8f01a-0595-4aab-930a-990481adef47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:02.970813 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8f01a-0595-4aab-930a-990481adef47 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:02.996031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1250/2515] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:02 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:03.000217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75512-e37f-4e5d-be41-d9146d69a422 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.011359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75512-e37f-4e5d-be41-d9146d69a422 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.067846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db61b6-573f-426c-b624-fe5e4875d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.068442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db61b6-573f-426c-b624-fe5e4875d365 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.068765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db61b6-573f-426c-b624-fe5e4875d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.069076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db61b6-573f-426c-b624-fe5e4875d365 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.069765 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db61b6-573f-426c-b624-fe5e4875d365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.071690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db61b6-573f-426c-b624-fe5e4875d365 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.092330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1266/2516] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:02 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:03.096539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8f01a-0595-4aab-930a-990481adef47 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.106803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8f01a-0595-4aab-930a-990481adef47 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.111401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e3e97-cd4e-4ca5-9757-b447c7f01d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.112058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e3e97-cd4e-4ca5-9757-b447c7f01d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.112346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e3e97-cd4e-4ca5-9757-b447c7f01d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.112647 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e3e97-cd4e-4ca5-9757-b447c7f01d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.113381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e3e97-cd4e-4ca5-9757-b447c7f01d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.115027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e3e97-cd4e-4ca5-9757-b447c7f01d8e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.125476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1251/2517] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:03.129914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db61b6-573f-426c-b624-fe5e4875d365 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.139795 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db61b6-573f-426c-b624-fe5e4875d365 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.145095 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9584793-0865-43b5-9b78-b8ea09e04627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.145749 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9584793-0865-43b5-9b78-b8ea09e04627 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.146036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9584793-0865-43b5-9b78-b8ea09e04627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.146320 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9584793-0865-43b5-9b78-b8ea09e04627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.147046 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9584793-0865-43b5-9b78-b8ea09e04627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.148656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9584793-0865-43b5-9b78-b8ea09e04627 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.158647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1267/2518] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:03.162662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e3e97-cd4e-4ca5-9757-b447c7f01d8e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.172882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e3e97-cd4e-4ca5-9757-b447c7f01d8e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.177519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb558ad-b4b2-417a-a25e-7fd9f57050f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.178390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb558ad-b4b2-417a-a25e-7fd9f57050f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.178675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb558ad-b4b2-417a-a25e-7fd9f57050f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.178954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb558ad-b4b2-417a-a25e-7fd9f57050f5 admin admin] PATH_INFO: `/v3/projects/f4a82a6dfe8a426fa46c63efc3568a86/users/ae57b03842804e8fb34c10e5f6e0ce76/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.193836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb558ad-b4b2-417a-a25e-7fd9f57050f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a82a6dfe8a426fa46c63efc3568a86, user_id=ae57b03842804e8fb34c10e5f6e0ce76, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.196483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb558ad-b4b2-417a-a25e-7fd9f57050f5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.209803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1252/2519] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:03 2022] PUT /identity/v3/projects/f4a82a6dfe8a426fa46c63efc3568a86/users/ae57b03842804e8fb34c10e5f6e0ce76/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:03.219891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32baa3-97e3-4bd4-911c-ffcf39ffaa3a None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.220374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32baa3-97e3-4bd4-911c-ffcf39ffaa3a None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.220471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32baa3-97e3-4bd4-911c-ffcf39ffaa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.246861 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4d32baa3-97e3-4bd4-911c-ffcf39ffaa3a None None] MFA Rules not processed for user `ae57b03842804e8fb34c10e5f6e0ce76`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:03.248050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4d32baa3-97e3-4bd4-911c-ffcf39ffaa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:03.260862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:03.316494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1268/2520] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:03.321036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb558ad-b4b2-417a-a25e-7fd9f57050f5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.383024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb558ad-b4b2-417a-a25e-7fd9f57050f5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.387765 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9b4c1-d98f-4160-9368-17e6317ead11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.388418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9b4c1-d98f-4160-9368-17e6317ead11 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.388748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9b4c1-d98f-4160-9368-17e6317ead11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.389032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9b4c1-d98f-4160-9368-17e6317ead11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.389720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9b4c1-d98f-4160-9368-17e6317ead11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.391635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9b4c1-d98f-4160-9368-17e6317ead11 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.410698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:03.419939 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1253/2521] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:03 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:03.424554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32baa3-97e3-4bd4-911c-ffcf39ffaa3a None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.435438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32baa3-97e3-4bd4-911c-ffcf39ffaa3a None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.490993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51b00-b272-404e-bd70-bf49a0d02881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.491659 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51b00-b272-404e-bd70-bf49a0d02881 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.491946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51b00-b272-404e-bd70-bf49a0d02881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.492224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51b00-b272-404e-bd70-bf49a0d02881 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.492939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d51b00-b272-404e-bd70-bf49a0d02881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.494863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d51b00-b272-404e-bd70-bf49a0d02881 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.515254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1269/2522] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:03 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:03.519312 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9b4c1-d98f-4160-9368-17e6317ead11 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.529619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9b4c1-d98f-4160-9368-17e6317ead11 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.534448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc27b-2f5a-4acf-804d-e52ec605fbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.535100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc27b-2f5a-4acf-804d-e52ec605fbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.535388 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc27b-2f5a-4acf-804d-e52ec605fbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.535687 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc27b-2f5a-4acf-804d-e52ec605fbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.536394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc27b-2f5a-4acf-804d-e52ec605fbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.538050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc27b-2f5a-4acf-804d-e52ec605fbd5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.549319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1254/2523] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:03.553589 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51b00-b272-404e-bd70-bf49a0d02881 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.563471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51b00-b272-404e-bd70-bf49a0d02881 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.568745 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383e605-e855-4ec2-902a-93ee72393a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.569617 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e605-e855-4ec2-902a-93ee72393a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.569899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e605-e855-4ec2-902a-93ee72393a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.570174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e605-e855-4ec2-902a-93ee72393a28 admin admin] PATH_INFO: `/v3/projects/f8aaa7865dfb4bc2a3b660baadc040b7/users/1d84a22180874ae9bd33d3ee256cca05/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.584647 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383e605-e855-4ec2-902a-93ee72393a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8aaa7865dfb4bc2a3b660baadc040b7, user_id=1d84a22180874ae9bd33d3ee256cca05, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.587294 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383e605-e855-4ec2-902a-93ee72393a28 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.600000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1270/2524] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:03 2022] PUT /identity/v3/projects/f8aaa7865dfb4bc2a3b660baadc040b7/users/1d84a22180874ae9bd33d3ee256cca05/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:03.603919 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc27b-2f5a-4acf-804d-e52ec605fbd5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.614830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc27b-2f5a-4acf-804d-e52ec605fbd5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.671804 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb93dc3-8b7e-47fe-b941-2cd751bc64a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.672467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb93dc3-8b7e-47fe-b941-2cd751bc64a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.672787 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb93dc3-8b7e-47fe-b941-2cd751bc64a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.673068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb93dc3-8b7e-47fe-b941-2cd751bc64a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.673790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb93dc3-8b7e-47fe-b941-2cd751bc64a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.675881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb93dc3-8b7e-47fe-b941-2cd751bc64a6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.685635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1255/2525] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:03.690231 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383e605-e855-4ec2-902a-93ee72393a28 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.700877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383e605-e855-4ec2-902a-93ee72393a28 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.705606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e2219-af0f-48fa-878c-9e019fffe741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.706480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e2219-af0f-48fa-878c-9e019fffe741 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.706763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e2219-af0f-48fa-878c-9e019fffe741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.707038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e2219-af0f-48fa-878c-9e019fffe741 admin admin] PATH_INFO: `/v3/projects/f8aaa7865dfb4bc2a3b660baadc040b7/users/1d84a22180874ae9bd33d3ee256cca05/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.709035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e2219-af0f-48fa-878c-9e019fffe741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8aaa7865dfb4bc2a3b660baadc040b7, user_id=1d84a22180874ae9bd33d3ee256cca05, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.711697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e2219-af0f-48fa-878c-9e019fffe741 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.721860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1271/2526] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:03 2022] PUT /identity/v3/projects/f8aaa7865dfb4bc2a3b660baadc040b7/users/1d84a22180874ae9bd33d3ee256cca05/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:03.733024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7623d-63ef-414a-933d-c4f517829a8a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.733523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7623d-63ef-414a-933d-c4f517829a8a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.733632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7623d-63ef-414a-933d-c4f517829a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.761312 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d2b7623d-63ef-414a-933d-c4f517829a8a None None] MFA Rules not processed for user `1d84a22180874ae9bd33d3ee256cca05`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:03.762516 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d2b7623d-63ef-414a-933d-c4f517829a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:03.830524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1256/2527] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:03.841600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e2219-af0f-48fa-878c-9e019fffe741 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:03.843337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7b6e2219-af0f-48fa-878c-9e019fffe741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:03.900226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e2219-af0f-48fa-878c-9e019fffe741 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:03.903890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdf58f-af13-45f9-b159-a36aaf69460b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:03.904524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdf58f-af13-45f9-b159-a36aaf69460b service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:03.904850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdf58f-af13-45f9-b159-a36aaf69460b service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:03.905132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdf58f-af13-45f9-b159-a36aaf69460b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:03.914748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdf58f-af13-45f9-b159-a36aaf69460b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:03.916437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdf58f-af13-45f9-b159-a36aaf69460b service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:03.926378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1272/2528] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:03.996010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7623d-63ef-414a-933d-c4f517829a8a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:04.006056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7623d-63ef-414a-933d-c4f517829a8a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:04.009696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e284c9d-eed6-46c6-b51b-ce52314dec02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:04.010336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e284c9d-eed6-46c6-b51b-ce52314dec02 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:04.010624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e284c9d-eed6-46c6-b51b-ce52314dec02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:04.010907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e284c9d-eed6-46c6-b51b-ce52314dec02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:04.067349 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e284c9d-eed6-46c6-b51b-ce52314dec02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:04.068816 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e284c9d-eed6-46c6-b51b-ce52314dec02 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:04.077677 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1257/2529] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:11.012706 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdf58f-af13-45f9-b159-a36aaf69460b service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.025938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:11.078804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdf58f-af13-45f9-b159-a36aaf69460b service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.084208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.085114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.085402 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.085679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] PATH_INFO: `/v3/users/ae57b03842804e8fb34c10e5f6e0ce76` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.086870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae57b03842804e8fb34c10e5f6e0ce76)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.088840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.137442 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae57b03842804e8fb34c10e5f6e0ce76'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.144810 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae57b03842804e8fb34c10e5f6e0ce76'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.145482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae57b03842804e8fb34c10e5f6e0ce76'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.146099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae57b03842804e8fb34c10e5f6e0ce76'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.157781 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae57b03842804e8fb34c10e5f6e0ce76'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.171148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1273/2530] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:11 2022] DELETE /identity/v3/users/ae57b03842804e8fb34c10e5f6e0ce76 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:11.176011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36985c3-5adc-4e97-bea0-c4918178f7c4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.176524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36985c3-5adc-4e97-bea0-c4918178f7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.176659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36985c3-5adc-4e97-bea0-c4918178f7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.188416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:11.194821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f36985c3-5adc-4e97-bea0-c4918178f7c4 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:11.195991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f36985c3-5adc-4e97-bea0-c4918178f7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:11.255202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1258/2531] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:11.264868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.266272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:11.324017 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b8e32-db03-414a-9676-e52753e03a62 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.327691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60acd-a8c0-4061-9e03-71ee57d1e635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.328335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60acd-a8c0-4061-9e03-71ee57d1e635 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.328637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60acd-a8c0-4061-9e03-71ee57d1e635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.328930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60acd-a8c0-4061-9e03-71ee57d1e635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.338540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e60acd-a8c0-4061-9e03-71ee57d1e635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.339973 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e60acd-a8c0-4061-9e03-71ee57d1e635 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.349790 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1274/2532] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:11.610202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36985c3-5adc-4e97-bea0-c4918178f7c4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.612200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f36985c3-5adc-4e97-bea0-c4918178f7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:11.625768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36985c3-5adc-4e97-bea0-c4918178f7c4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.631405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.632280 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.632569 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.632897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] PATH_INFO: `/v3/projects/f4a82a6dfe8a426fa46c63efc3568a86` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.634095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a82a6dfe8a426fa46c63efc3568a86)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.636173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.682110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a82a6dfe8a426fa46c63efc3568a86', 'request_id': 'req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.688188 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a82a6dfe8a426fa46c63efc3568a86', 'request_id': 'req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.694699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a82a6dfe8a426fa46c63efc3568a86', 'request_id': 'req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.707136 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] The token cache is being invalidate because project f4a82a6dfe8a426fa46c63efc3568a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:11.707435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.708068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.709626 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1259/2533] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:11 2022] DELETE /identity/v3/projects/f4a82a6dfe8a426fa46c63efc3568a86 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:11.713566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60acd-a8c0-4061-9e03-71ee57d1e635 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:11.723800 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60acd-a8c0-4061-9e03-71ee57d1e635 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:11.753884 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:11.782606 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f79fc7-52ee-4333-bd1d-b8ff10c83042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:11.784138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79fc7-52ee-4333-bd1d-b8ff10c83042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:11.784430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79fc7-52ee-4333-bd1d-b8ff10c83042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:11.784746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79fc7-52ee-4333-bd1d-b8ff10c83042 admin admin] PATH_INFO: `/v3/users/1d84a22180874ae9bd33d3ee256cca05` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:11.785940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f79fc7-52ee-4333-bd1d-b8ff10c83042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d84a22180874ae9bd33d3ee256cca05)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:11.787872 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f79fc7-52ee-4333-bd1d-b8ff10c83042 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:11.832488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b1f79fc7-52ee-4333-bd1d-b8ff10c83042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d84a22180874ae9bd33d3ee256cca05'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.839375 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b1f79fc7-52ee-4333-bd1d-b8ff10c83042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d84a22180874ae9bd33d3ee256cca05'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.840043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b1f79fc7-52ee-4333-bd1d-b8ff10c83042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d84a22180874ae9bd33d3ee256cca05'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.840694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b1f79fc7-52ee-4333-bd1d-b8ff10c83042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d84a22180874ae9bd33d3ee256cca05'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.853226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b1f79fc7-52ee-4333-bd1d-b8ff10c83042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d84a22180874ae9bd33d3ee256cca05'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:11.865508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1275/2534] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:11 2022] DELETE /identity/v3/users/1d84a22180874ae9bd33d3ee256cca05 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:12.137068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.138554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.152130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd47ed0-ecc7-4b55-b3a9-01230f5143df admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.208279 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.209186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.209474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.209754 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] PATH_INFO: `/v3/projects/f8aaa7865dfb4bc2a3b660baadc040b7` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.210931 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8aaa7865dfb4bc2a3b660baadc040b7)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.212876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.250756 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:12.267123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8aaa7865dfb4bc2a3b660baadc040b7', 'request_id': 'req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.274098 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8aaa7865dfb4bc2a3b660baadc040b7', 'request_id': 'req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.279699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8aaa7865dfb4bc2a3b660baadc040b7', 'request_id': 'req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.292252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] The token cache is being invalidate because project f8aaa7865dfb4bc2a3b660baadc040b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:12.292540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.293182 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fa49d471-a2f2-42d7-8d89-8a3c8df37bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:12.294712 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1260/2535] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:12 2022] DELETE /identity/v3/projects/f8aaa7865dfb4bc2a3b660baadc040b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:12.300883 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d807eb-9d8a-4c5d-ae78-04305c9a214d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.301389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d807eb-9d8a-4c5d-ae78-04305c9a214d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.301496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d807eb-9d8a-4c5d-ae78-04305c9a214d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.320161 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-06d807eb-9d8a-4c5d-ae78-04305c9a214d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:12.321443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-06d807eb-9d8a-4c5d-ae78-04305c9a214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.380292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1276/2536] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:12.387887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6d3fb-e896-4326-9adb-b9d79375956c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.388186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6d3fb-e896-4326-9adb-b9d79375956c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.388477 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6d3fb-e896-4326-9adb-b9d79375956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.407052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4df6d3fb-e896-4326-9adb-b9d79375956c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:12.408256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4df6d3fb-e896-4326-9adb-b9d79375956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.416668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1261/2537] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:12.420789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d807eb-9d8a-4c5d-ae78-04305c9a214d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.430984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d807eb-9d8a-4c5d-ae78-04305c9a214d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.435551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d2318-8b8e-4c23-a562-cd0b2e3a10f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.436194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2318-8b8e-4c23-a562-cd0b2e3a10f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.436473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2318-8b8e-4c23-a562-cd0b2e3a10f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.436787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2318-8b8e-4c23-a562-cd0b2e3a10f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.437536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d2318-8b8e-4c23-a562-cd0b2e3a10f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:12.437842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d2318-8b8e-4c23-a562-cd0b2e3a10f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.439464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d2318-8b8e-4c23-a562-cd0b2e3a10f9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.451726 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1277/2538] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:12.457170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6d3fb-e896-4326-9adb-b9d79375956c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.467364 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6d3fb-e896-4326-9adb-b9d79375956c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.472755 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2efed-be94-4dfc-a404-92169fe45903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.473407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2efed-be94-4dfc-a404-92169fe45903 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.473695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2efed-be94-4dfc-a404-92169fe45903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.473972 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2efed-be94-4dfc-a404-92169fe45903 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.474666 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2efed-be94-4dfc-a404-92169fe45903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.476564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2efed-be94-4dfc-a404-92169fe45903 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.501791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1262/2539] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:12 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:12.506155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d2318-8b8e-4c23-a562-cd0b2e3a10f9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.516124 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d2318-8b8e-4c23-a562-cd0b2e3a10f9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.555214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:12.576005 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889578c-1b5f-4cbd-965c-3702d3899ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.576699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889578c-1b5f-4cbd-965c-3702d3899ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.576986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889578c-1b5f-4cbd-965c-3702d3899ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.577263 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889578c-1b5f-4cbd-965c-3702d3899ffa admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.577953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889578c-1b5f-4cbd-965c-3702d3899ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.579863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889578c-1b5f-4cbd-965c-3702d3899ffa admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.601140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1278/2540] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:12 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:12.605410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2efed-be94-4dfc-a404-92169fe45903 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.616025 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2efed-be94-4dfc-a404-92169fe45903 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.621937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a36152-6ccb-47b3-a4a8-86d8d146e2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.623110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36152-6ccb-47b3-a4a8-86d8d146e2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.623629 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36152-6ccb-47b3-a4a8-86d8d146e2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.624117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36152-6ccb-47b3-a4a8-86d8d146e2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.625539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a36152-6ccb-47b3-a4a8-86d8d146e2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.628571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a36152-6ccb-47b3-a4a8-86d8d146e2f3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.640631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1263/2541] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:12.645194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889578c-1b5f-4cbd-965c-3702d3899ffa admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.655086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889578c-1b5f-4cbd-965c-3702d3899ffa admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.660308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008b0fc-38dc-424a-a73b-d87e575b9319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.660994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008b0fc-38dc-424a-a73b-d87e575b9319 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.661274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008b0fc-38dc-424a-a73b-d87e575b9319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.661553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008b0fc-38dc-424a-a73b-d87e575b9319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.662269 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008b0fc-38dc-424a-a73b-d87e575b9319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.663862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008b0fc-38dc-424a-a73b-d87e575b9319 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.673881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1279/2542] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:12.678152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a36152-6ccb-47b3-a4a8-86d8d146e2f3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.687829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a36152-6ccb-47b3-a4a8-86d8d146e2f3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.692974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf7912-1431-4459-a035-7465cf38f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.693864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf7912-1431-4459-a035-7465cf38f31f admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.694145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf7912-1431-4459-a035-7465cf38f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.694419 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf7912-1431-4459-a035-7465cf38f31f admin admin] PATH_INFO: `/v3/projects/6643b5c0962d47d39739946296e017de/users/f35da9db5b694c9b9dc4c7cc8412979f/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.709676 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf7912-1431-4459-a035-7465cf38f31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6643b5c0962d47d39739946296e017de, user_id=f35da9db5b694c9b9dc4c7cc8412979f, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.712315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf7912-1431-4459-a035-7465cf38f31f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.726179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1264/2543] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:12 2022] PUT /identity/v3/projects/6643b5c0962d47d39739946296e017de/users/f35da9db5b694c9b9dc4c7cc8412979f/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:12.736369 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8ec9-06ef-4554-904e-4922dcedaf66 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.736705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8ec9-06ef-4554-904e-4922dcedaf66 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.737255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8ec9-06ef-4554-904e-4922dcedaf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.763142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3d6b8ec9-06ef-4554-904e-4922dcedaf66 None None] MFA Rules not processed for user `f35da9db5b694c9b9dc4c7cc8412979f`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:12.764356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3d6b8ec9-06ef-4554-904e-4922dcedaf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:12.828309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1280/2544] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:12.833159 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf7912-1431-4459-a035-7465cf38f31f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.895184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf7912-1431-4459-a035-7465cf38f31f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.899786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb23b2c-ea20-426e-a97a-44ccc58a87df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.900433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb23b2c-ea20-426e-a97a-44ccc58a87df admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.900755 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb23b2c-ea20-426e-a97a-44ccc58a87df admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.901036 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb23b2c-ea20-426e-a97a-44ccc58a87df admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:12.901739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb23b2c-ea20-426e-a97a-44ccc58a87df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:12.903624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb23b2c-ea20-426e-a97a-44ccc58a87df admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:12.928054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1265/2545] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:12 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:12.932150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8ec9-06ef-4554-904e-4922dcedaf66 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:12.943570 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8ec9-06ef-4554-904e-4922dcedaf66 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:12.998472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c366a36-ef6f-43fd-9139-1f4c789ba1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:12.999134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c366a36-ef6f-43fd-9139-1f4c789ba1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:12.999421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c366a36-ef6f-43fd-9139-1f4c789ba1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:12.999697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c366a36-ef6f-43fd-9139-1f4c789ba1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.000388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c366a36-ef6f-43fd-9139-1f4c789ba1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.002881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c366a36-ef6f-43fd-9139-1f4c789ba1f8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.022865 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1281/2546] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:12 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:13.026803 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb23b2c-ea20-426e-a97a-44ccc58a87df admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.037059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb23b2c-ea20-426e-a97a-44ccc58a87df admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.041928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2833db-ac49-437d-b9a7-ad946256c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.042581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2833db-ac49-437d-b9a7-ad946256c864 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.042869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2833db-ac49-437d-b9a7-ad946256c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.043152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2833db-ac49-437d-b9a7-ad946256c864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.043876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2833db-ac49-437d-b9a7-ad946256c864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.045511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2833db-ac49-437d-b9a7-ad946256c864 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.057277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1266/2547] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:13.061162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c366a36-ef6f-43fd-9139-1f4c789ba1f8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.071520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c366a36-ef6f-43fd-9139-1f4c789ba1f8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.076133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb66b40-bc52-471a-b358-c76457668182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.077044 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb66b40-bc52-471a-b358-c76457668182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.077333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb66b40-bc52-471a-b358-c76457668182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.077615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb66b40-bc52-471a-b358-c76457668182 admin admin] PATH_INFO: `/v3/projects/702764461ae14ca29b90cdd050840538/users/7bc0f5af988e4ab9a62050e80f7fbce4/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.092838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb66b40-bc52-471a-b358-c76457668182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702764461ae14ca29b90cdd050840538, user_id=7bc0f5af988e4ab9a62050e80f7fbce4, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.095497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb66b40-bc52-471a-b358-c76457668182 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.109448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1282/2548] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:13 2022] PUT /identity/v3/projects/702764461ae14ca29b90cdd050840538/users/7bc0f5af988e4ab9a62050e80f7fbce4/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:13.114058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2833db-ac49-437d-b9a7-ad946256c864 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.124354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2833db-ac49-437d-b9a7-ad946256c864 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.152929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:13.182952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f7fd4-14e2-4175-815d-94c56c20d49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.183614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f7fd4-14e2-4175-815d-94c56c20d49e admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.183899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f7fd4-14e2-4175-815d-94c56c20d49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.184176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f7fd4-14e2-4175-815d-94c56c20d49e admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.184942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f7fd4-14e2-4175-815d-94c56c20d49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.186530 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f7fd4-14e2-4175-815d-94c56c20d49e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.196946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1267/2549] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:13.201163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb66b40-bc52-471a-b358-c76457668182 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.211848 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb66b40-bc52-471a-b358-c76457668182 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.216435 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592fd17-32b7-4f19-8e33-6ac4e6de3eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.217337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592fd17-32b7-4f19-8e33-6ac4e6de3eab admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.217622 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592fd17-32b7-4f19-8e33-6ac4e6de3eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.217899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592fd17-32b7-4f19-8e33-6ac4e6de3eab admin admin] PATH_INFO: `/v3/projects/702764461ae14ca29b90cdd050840538/users/7bc0f5af988e4ab9a62050e80f7fbce4/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.219832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592fd17-32b7-4f19-8e33-6ac4e6de3eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=702764461ae14ca29b90cdd050840538, user_id=7bc0f5af988e4ab9a62050e80f7fbce4, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.222981 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592fd17-32b7-4f19-8e33-6ac4e6de3eab admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.229095 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:13.234665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1283/2550] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:13 2022] PUT /identity/v3/projects/702764461ae14ca29b90cdd050840538/users/7bc0f5af988e4ab9a62050e80f7fbce4/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:13.246812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c07a3f-dfae-418d-a5f8-58994994cfae None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.247331 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c07a3f-dfae-418d-a5f8-58994994cfae None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.247438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c07a3f-dfae-418d-a5f8-58994994cfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.273690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a6c07a3f-dfae-418d-a5f8-58994994cfae None None] MFA Rules not processed for user `7bc0f5af988e4ab9a62050e80f7fbce4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:13.274917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a6c07a3f-dfae-418d-a5f8-58994994cfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:13.341925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1268/2551] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:13.353251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592fd17-32b7-4f19-8e33-6ac4e6de3eab admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:13.354969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7592fd17-32b7-4f19-8e33-6ac4e6de3eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:13.412219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592fd17-32b7-4f19-8e33-6ac4e6de3eab admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:13.416152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f11c50-ecb1-4b59-8a1c-3a555fd07a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:13.416814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f11c50-ecb1-4b59-8a1c-3a555fd07a3c service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:13.417101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f11c50-ecb1-4b59-8a1c-3a555fd07a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:13.417377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f11c50-ecb1-4b59-8a1c-3a555fd07a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:13.473304 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f11c50-ecb1-4b59-8a1c-3a555fd07a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:13.474753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f11c50-ecb1-4b59-8a1c-3a555fd07a3c service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:13.483633 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1284/2552] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:14.828353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c07a3f-dfae-418d-a5f8-58994994cfae None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:14.829840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a6c07a3f-dfae-418d-a5f8-58994994cfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:14.842282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c07a3f-dfae-418d-a5f8-58994994cfae None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:14.845997 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262863ae-79eb-4050-a422-998017150799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:14.847354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262863ae-79eb-4050-a422-998017150799 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:14.847643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262863ae-79eb-4050-a422-998017150799 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:14.847951 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262863ae-79eb-4050-a422-998017150799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:14.857009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262863ae-79eb-4050-a422-998017150799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:14.858425 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262863ae-79eb-4050-a422-998017150799 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:14.867962 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1269/2553] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:18.611273 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f11c50-ecb1-4b59-8a1c-3a555fd07a3c service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.673495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f11c50-ecb1-4b59-8a1c-3a555fd07a3c service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.678090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.679239 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.679530 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.679808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] PATH_INFO: `/v3/users/f35da9db5b694c9b9dc4c7cc8412979f` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.681019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35da9db5b694c9b9dc4c7cc8412979f)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.682940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.733036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35da9db5b694c9b9dc4c7cc8412979f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:18.745787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35da9db5b694c9b9dc4c7cc8412979f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:18.746503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35da9db5b694c9b9dc4c7cc8412979f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:18.747125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35da9db5b694c9b9dc4c7cc8412979f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:18.748283 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:18.761729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35da9db5b694c9b9dc4c7cc8412979f'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:18.775564 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1285/2554] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:18 2022] DELETE /identity/v3/users/f35da9db5b694c9b9dc4c7cc8412979f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:18.780073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00822-b5e4-4de4-afb5-1e91a78c4c17 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.780564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00822-b5e4-4de4-afb5-1e91a78c4c17 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.781089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00822-b5e4-4de4-afb5-1e91a78c4c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.798350 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-63d00822-b5e4-4de4-afb5-1e91a78c4c17 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:18.799593 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-63d00822-b5e4-4de4-afb5-1e91a78c4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:18.860766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1270/2555] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:18.870319 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:18.871737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:18.929746 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf978fb-f920-403a-ab05-c7037c7a880f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:18.933423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acac5ab-a40f-483d-89df-9229227dbf36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:18.934071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acac5ab-a40f-483d-89df-9229227dbf36 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:18.934359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acac5ab-a40f-483d-89df-9229227dbf36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:18.934637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acac5ab-a40f-483d-89df-9229227dbf36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:18.944103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acac5ab-a40f-483d-89df-9229227dbf36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:18.945574 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acac5ab-a40f-483d-89df-9229227dbf36 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:18.954966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1286/2556] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:20:19.224477 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d00822-b5e4-4de4-afb5-1e91a78c4c17 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:19.226108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-63d00822-b5e4-4de4-afb5-1e91a78c4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:19.240553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d00822-b5e4-4de4-afb5-1e91a78c4c17 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:19.245094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:19.246174 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:19.246467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:19.246745 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] PATH_INFO: `/v3/projects/6643b5c0962d47d39739946296e017de` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:19.248078 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6643b5c0962d47d39739946296e017de)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:19.250139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:19.289236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:19.300970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6643b5c0962d47d39739946296e017de', 'request_id': 'req-587c6b9c-f4fe-4f9c-9288-cf333c896577'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.307128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6643b5c0962d47d39739946296e017de', 'request_id': 'req-587c6b9c-f4fe-4f9c-9288-cf333c896577'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.312763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6643b5c0962d47d39739946296e017de', 'request_id': 'req-587c6b9c-f4fe-4f9c-9288-cf333c896577'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.326100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] The token cache is being invalidate because project 6643b5c0962d47d39739946296e017de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:19.326422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.327055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.328597 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1271/2557] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:19 2022] DELETE /identity/v3/projects/6643b5c0962d47d39739946296e017de => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:19.332669 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acac5ab-a40f-483d-89df-9229227dbf36 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:19.342176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acac5ab-a40f-483d-89df-9229227dbf36 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:19.397804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70431c16-cbdd-4cb2-b572-9a3b04328aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:19.398673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70431c16-cbdd-4cb2-b572-9a3b04328aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:19.398960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70431c16-cbdd-4cb2-b572-9a3b04328aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:19.399240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70431c16-cbdd-4cb2-b572-9a3b04328aaf admin admin] PATH_INFO: `/v3/users/7bc0f5af988e4ab9a62050e80f7fbce4` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:19.400418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70431c16-cbdd-4cb2-b572-9a3b04328aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc0f5af988e4ab9a62050e80f7fbce4)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:19.402389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70431c16-cbdd-4cb2-b572-9a3b04328aaf admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:19.447575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-70431c16-cbdd-4cb2-b572-9a3b04328aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc0f5af988e4ab9a62050e80f7fbce4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.454501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-70431c16-cbdd-4cb2-b572-9a3b04328aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc0f5af988e4ab9a62050e80f7fbce4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.455219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-70431c16-cbdd-4cb2-b572-9a3b04328aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc0f5af988e4ab9a62050e80f7fbce4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.455937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-70431c16-cbdd-4cb2-b572-9a3b04328aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc0f5af988e4ab9a62050e80f7fbce4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.469078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-70431c16-cbdd-4cb2-b572-9a3b04328aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc0f5af988e4ab9a62050e80f7fbce4'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.472607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:19.483061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1287/2558] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:19 2022] DELETE /identity/v3/users/7bc0f5af988e4ab9a62050e80f7fbce4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:19.756193 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:19.757690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:19.774162 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c6b9c-f4fe-4f9c-9288-cf333c896577 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:19.832460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:19.833365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:19.833654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:19.833961 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] PATH_INFO: `/v3/projects/702764461ae14ca29b90cdd050840538` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:19.835171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=702764461ae14ca29b90cdd050840538)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:19.837115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:19.887183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702764461ae14ca29b90cdd050840538', 'request_id': 'req-5e04350b-7bf9-462d-8984-95aba731ab41'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.895232 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702764461ae14ca29b90cdd050840538', 'request_id': 'req-5e04350b-7bf9-462d-8984-95aba731ab41'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.901127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702764461ae14ca29b90cdd050840538', 'request_id': 'req-5e04350b-7bf9-462d-8984-95aba731ab41'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.917606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] The token cache is being invalidate because project 702764461ae14ca29b90cdd050840538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:19.918262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.919277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5e04350b-7bf9-462d-8984-95aba731ab41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:19.921440 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1272/2559] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:19 2022] DELETE /identity/v3/projects/702764461ae14ca29b90cdd050840538 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:19.927799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474f3ad-414f-4dfd-aeb7-aa085e36a56c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:19.928344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474f3ad-414f-4dfd-aeb7-aa085e36a56c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:19.928850 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474f3ad-414f-4dfd-aeb7-aa085e36a56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:19.952163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0474f3ad-414f-4dfd-aeb7-aa085e36a56c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:19.953415 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0474f3ad-414f-4dfd-aeb7-aa085e36a56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:20.027596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1288/2560] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:20.035014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228ed57-b193-4c2e-ba88-7d997a0227d0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.035830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228ed57-b193-4c2e-ba88-7d997a0227d0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.036325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228ed57-b193-4c2e-ba88-7d997a0227d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.060109 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c228ed57-b193-4c2e-ba88-7d997a0227d0 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:20.061805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c228ed57-b193-4c2e-ba88-7d997a0227d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:20.071967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1273/2561] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:20.076466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474f3ad-414f-4dfd-aeb7-aa085e36a56c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.086983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474f3ad-414f-4dfd-aeb7-aa085e36a56c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.091807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaaf99-9515-4147-aa1b-288788021855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.092477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaaf99-9515-4147-aa1b-288788021855 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.092814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaaf99-9515-4147-aa1b-288788021855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.093103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaaf99-9515-4147-aa1b-288788021855 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.093852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaaf99-9515-4147-aa1b-288788021855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:20.094150 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaaf99-9515-4147-aa1b-288788021855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.095919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaaf99-9515-4147-aa1b-288788021855 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.115191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1289/2562] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:20.116694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228ed57-b193-4c2e-ba88-7d997a0227d0 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.127068 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228ed57-b193-4c2e-ba88-7d997a0227d0 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.132544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386129c0-d651-49dc-9dab-118f77513d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.133241 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386129c0-d651-49dc-9dab-118f77513d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.133514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386129c0-d651-49dc-9dab-118f77513d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.133785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386129c0-d651-49dc-9dab-118f77513d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.134470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386129c0-d651-49dc-9dab-118f77513d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.136363 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386129c0-d651-49dc-9dab-118f77513d54 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.167681 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1274/2563] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:20.171707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaaf99-9515-4147-aa1b-288788021855 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.182453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaaf99-9515-4147-aa1b-288788021855 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.242970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca66496-655f-48b2-9cd5-ae7b81aa79a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.243635 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca66496-655f-48b2-9cd5-ae7b81aa79a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.243925 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca66496-655f-48b2-9cd5-ae7b81aa79a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.244198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca66496-655f-48b2-9cd5-ae7b81aa79a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.244930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca66496-655f-48b2-9cd5-ae7b81aa79a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.246846 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca66496-655f-48b2-9cd5-ae7b81aa79a1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.266699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1290/2564] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:20.271003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386129c0-d651-49dc-9dab-118f77513d54 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.281112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386129c0-d651-49dc-9dab-118f77513d54 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.286617 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cab978-2bda-4cad-b51d-c0bae8bafa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.287265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab978-2bda-4cad-b51d-c0bae8bafa4d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.287548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab978-2bda-4cad-b51d-c0bae8bafa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.287857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab978-2bda-4cad-b51d-c0bae8bafa4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.288578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cab978-2bda-4cad-b51d-c0bae8bafa4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.290452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cab978-2bda-4cad-b51d-c0bae8bafa4d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.302743 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1275/2565] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:20.306845 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca66496-655f-48b2-9cd5-ae7b81aa79a1 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.316972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca66496-655f-48b2-9cd5-ae7b81aa79a1 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.321704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec83600-4b79-4650-a820-34a580bde7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.322365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec83600-4b79-4650-a820-34a580bde7ac admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.322653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec83600-4b79-4650-a820-34a580bde7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.322936 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec83600-4b79-4650-a820-34a580bde7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.323667 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec83600-4b79-4650-a820-34a580bde7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.325321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec83600-4b79-4650-a820-34a580bde7ac admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.335494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1291/2566] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:20.339753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cab978-2bda-4cad-b51d-c0bae8bafa4d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.350540 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cab978-2bda-4cad-b51d-c0bae8bafa4d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.355192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ec52b-d9f0-4596-a985-0055346726dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.356067 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ec52b-d9f0-4596-a985-0055346726dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.356356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ec52b-d9f0-4596-a985-0055346726dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.356660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ec52b-d9f0-4596-a985-0055346726dd admin admin] PATH_INFO: `/v3/projects/dfd7f00483cd4501ba7d78e55a7248d4/users/f14438e00abe4031994266229fec1d3a/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.368205 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:20.372773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ec52b-d9f0-4596-a985-0055346726dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd7f00483cd4501ba7d78e55a7248d4, user_id=f14438e00abe4031994266229fec1d3a, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.375696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ec52b-d9f0-4596-a985-0055346726dd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.388864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1276/2567] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:20 2022] PUT /identity/v3/projects/dfd7f00483cd4501ba7d78e55a7248d4/users/f14438e00abe4031994266229fec1d3a/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:20.400401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb464-a1da-4d68-a642-e308b098e094 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.400742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb464-a1da-4d68-a642-e308b098e094 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.401123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb464-a1da-4d68-a642-e308b098e094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.429773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f8fdb464-a1da-4d68-a642-e308b098e094 None None] MFA Rules not processed for user `f14438e00abe4031994266229fec1d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:20.430991 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f8fdb464-a1da-4d68-a642-e308b098e094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:20.480358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:20.498926 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1292/2568] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:20.503414 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ec52b-d9f0-4596-a985-0055346726dd admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.565549 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ec52b-d9f0-4596-a985-0055346726dd admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.570147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5f0d5-24f8-43e4-aa94-3aa8ce1bb58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.570801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5f0d5-24f8-43e4-aa94-3aa8ce1bb58a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.571089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5f0d5-24f8-43e4-aa94-3aa8ce1bb58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.571370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5f0d5-24f8-43e4-aa94-3aa8ce1bb58a admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.572054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5f0d5-24f8-43e4-aa94-3aa8ce1bb58a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.573982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5f0d5-24f8-43e4-aa94-3aa8ce1bb58a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.599773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1277/2569] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:20.603805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdb464-a1da-4d68-a642-e308b098e094 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.615494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdb464-a1da-4d68-a642-e308b098e094 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.675662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fbc2a-e371-4611-9893-a009ab078b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.676325 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fbc2a-e371-4611-9893-a009ab078b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.676637 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fbc2a-e371-4611-9893-a009ab078b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.676911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fbc2a-e371-4611-9893-a009ab078b3f admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.677600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fbc2a-e371-4611-9893-a009ab078b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.679557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fbc2a-e371-4611-9893-a009ab078b3f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.698875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1293/2570] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:20.702823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5f0d5-24f8-43e4-aa94-3aa8ce1bb58a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.713534 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5f0d5-24f8-43e4-aa94-3aa8ce1bb58a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.718146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555b32c-6bef-4590-8d78-dd283f614e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.718800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b32c-6bef-4590-8d78-dd283f614e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.719088 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b32c-6bef-4590-8d78-dd283f614e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.719367 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b32c-6bef-4590-8d78-dd283f614e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.720096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555b32c-6bef-4590-8d78-dd283f614e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.722393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555b32c-6bef-4590-8d78-dd283f614e92 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.732965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1278/2571] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:20.737067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fbc2a-e371-4611-9893-a009ab078b3f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.747815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fbc2a-e371-4611-9893-a009ab078b3f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.752708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecd621-b008-4fdb-a875-b16ea2a1a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.753590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecd621-b008-4fdb-a875-b16ea2a1a94c admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.753877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecd621-b008-4fdb-a875-b16ea2a1a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.754154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecd621-b008-4fdb-a875-b16ea2a1a94c admin admin] PATH_INFO: `/v3/projects/4121a01bccfa4c1b8922767fdb9e9bda/users/c6e0384f004d42edbf85dfff88b750ee/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.769400 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecd621-b008-4fdb-a875-b16ea2a1a94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4121a01bccfa4c1b8922767fdb9e9bda, user_id=c6e0384f004d42edbf85dfff88b750ee, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.772095 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecd621-b008-4fdb-a875-b16ea2a1a94c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.788877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1294/2572] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:20 2022] PUT /identity/v3/projects/4121a01bccfa4c1b8922767fdb9e9bda/users/c6e0384f004d42edbf85dfff88b750ee/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:20.793086 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555b32c-6bef-4590-8d78-dd283f614e92 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.803243 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555b32c-6bef-4590-8d78-dd283f614e92 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.860775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adb7a8-cd13-45b2-8829-606bc3c7a7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.861442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adb7a8-cd13-45b2-8829-606bc3c7a7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.861750 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adb7a8-cd13-45b2-8829-606bc3c7a7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.862029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adb7a8-cd13-45b2-8829-606bc3c7a7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.862758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adb7a8-cd13-45b2-8829-606bc3c7a7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.864354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adb7a8-cd13-45b2-8829-606bc3c7a7a8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.874115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1279/2573] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:20.878466 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecd621-b008-4fdb-a875-b16ea2a1a94c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:20.888901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecd621-b008-4fdb-a875-b16ea2a1a94c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:20.894464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c087377-b06b-494e-b9b7-7cd3a841f0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:20.895331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c087377-b06b-494e-b9b7-7cd3a841f0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.895617 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c087377-b06b-494e-b9b7-7cd3a841f0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.895893 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c087377-b06b-494e-b9b7-7cd3a841f0f9 admin admin] PATH_INFO: `/v3/projects/4121a01bccfa4c1b8922767fdb9e9bda/users/c6e0384f004d42edbf85dfff88b750ee/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.897867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c087377-b06b-494e-b9b7-7cd3a841f0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4121a01bccfa4c1b8922767fdb9e9bda, user_id=c6e0384f004d42edbf85dfff88b750ee, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:20.900485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c087377-b06b-494e-b9b7-7cd3a841f0f9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:20.911812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1295/2574] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:20 2022] PUT /identity/v3/projects/4121a01bccfa4c1b8922767fdb9e9bda/users/c6e0384f004d42edbf85dfff88b750ee/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:20.921936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317b3b0-0e6d-45bd-a7c9-168c5d752eb4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:20.922232 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317b3b0-0e6d-45bd-a7c9-168c5d752eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:20.922513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317b3b0-0e6d-45bd-a7c9-168c5d752eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:20.948931 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4317b3b0-0e6d-45bd-a7c9-168c5d752eb4 None None] MFA Rules not processed for user `c6e0384f004d42edbf85dfff88b750ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:20.950130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4317b3b0-0e6d-45bd-a7c9-168c5d752eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:20.996279 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:21.022719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1280/2575] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:21.034754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c087377-b06b-494e-b9b7-7cd3a841f0f9 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:21.036757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7c087377-b06b-494e-b9b7-7cd3a841f0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:21.098286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c087377-b06b-494e-b9b7-7cd3a841f0f9 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:21.102257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cc2c8-8e1f-41cf-87b5-24dc74b7be46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:21.102978 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc2c8-8e1f-41cf-87b5-24dc74b7be46 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:21.103330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc2c8-8e1f-41cf-87b5-24dc74b7be46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:21.103678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc2c8-8e1f-41cf-87b5-24dc74b7be46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:21.114273 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cc2c8-8e1f-41cf-87b5-24dc74b7be46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:21.115773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cc2c8-8e1f-41cf-87b5-24dc74b7be46 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:21.125930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1296/2576] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:21.253658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317b3b0-0e6d-45bd-a7c9-168c5d752eb4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:21.265180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317b3b0-0e6d-45bd-a7c9-168c5d752eb4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:21.270230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce07a6-cf8f-4000-a202-4fb5db92a003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:21.270957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce07a6-cf8f-4000-a202-4fb5db92a003 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:21.271303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce07a6-cf8f-4000-a202-4fb5db92a003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:21.271651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce07a6-cf8f-4000-a202-4fb5db92a003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:21.341610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce07a6-cf8f-4000-a202-4fb5db92a003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:21.343569 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce07a6-cf8f-4000-a202-4fb5db92a003 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:21.354537 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1281/2577] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:21.616351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cc2c8-8e1f-41cf-87b5-24dc74b7be46 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:21.667154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:21.682438 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cc2c8-8e1f-41cf-87b5-24dc74b7be46 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:21.686937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:21.687794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:21.688075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:21.688350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] PATH_INFO: `/v3/users/f14438e00abe4031994266229fec1d3a` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:21.689544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14438e00abe4031994266229fec1d3a)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:21.691970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:21.737394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14438e00abe4031994266229fec1d3a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:21.744133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14438e00abe4031994266229fec1d3a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:21.744811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14438e00abe4031994266229fec1d3a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:21.745412 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14438e00abe4031994266229fec1d3a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:21.758037 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14438e00abe4031994266229fec1d3a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:21.770964 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1297/2578] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:21 2022] DELETE /identity/v3/users/f14438e00abe4031994266229fec1d3a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:21.775893 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf061ca-3d95-4405-98c3-4aa92c57530d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:21.776192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf061ca-3d95-4405-98c3-4aa92c57530d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:21.776476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf061ca-3d95-4405-98c3-4aa92c57530d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:21.793527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0cf061ca-3d95-4405-98c3-4aa92c57530d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:21.794752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0cf061ca-3d95-4405-98c3-4aa92c57530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:21.853909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1282/2579] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:21.863419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:21.864879 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:21.921426 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe0db3-8556-42b8-ade3-5027da77266a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:21.925124 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9da92b-fe0a-4d5b-b1ab-866828bb1659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:21.925807 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9da92b-fe0a-4d5b-b1ab-866828bb1659 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:21.926094 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9da92b-fe0a-4d5b-b1ab-866828bb1659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:21.926394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9da92b-fe0a-4d5b-b1ab-866828bb1659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:21.935309 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9da92b-fe0a-4d5b-b1ab-866828bb1659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:21.936813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9da92b-fe0a-4d5b-b1ab-866828bb1659 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:21.946773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1298/2580] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:22.215240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf061ca-3d95-4405-98c3-4aa92c57530d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:22.216827 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0cf061ca-3d95-4405-98c3-4aa92c57530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:22.229556 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf061ca-3d95-4405-98c3-4aa92c57530d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:22.234247 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:22.235127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:22.235975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:22.235975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] PATH_INFO: `/v3/projects/dfd7f00483cd4501ba7d78e55a7248d4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:22.237466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd7f00483cd4501ba7d78e55a7248d4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:22.239388 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:22.310905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd7f00483cd4501ba7d78e55a7248d4', 'request_id': 'req-a1a32c56-2f47-44a8-95bc-a9387f8d454c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:22.319394 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd7f00483cd4501ba7d78e55a7248d4', 'request_id': 'req-a1a32c56-2f47-44a8-95bc-a9387f8d454c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:22.330490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd7f00483cd4501ba7d78e55a7248d4', 'request_id': 'req-a1a32c56-2f47-44a8-95bc-a9387f8d454c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:22.347306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] The token cache is being invalidate because project dfd7f00483cd4501ba7d78e55a7248d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:22.348221 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:22.348907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:22.356371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1283/2581] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:22 2022] DELETE /identity/v3/projects/dfd7f00483cd4501ba7d78e55a7248d4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:22.360114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9da92b-fe0a-4d5b-b1ab-866828bb1659 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:22.373720 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9da92b-fe0a-4d5b-b1ab-866828bb1659 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:22.455147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eb6d4-03dc-4046-9079-c0464f5e8d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:22.456657 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eb6d4-03dc-4046-9079-c0464f5e8d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:22.457116 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eb6d4-03dc-4046-9079-c0464f5e8d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:22.457453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eb6d4-03dc-4046-9079-c0464f5e8d66 admin admin] PATH_INFO: `/v3/users/c6e0384f004d42edbf85dfff88b750ee` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:22.459069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8eb6d4-03dc-4046-9079-c0464f5e8d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e0384f004d42edbf85dfff88b750ee)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:22.461183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8eb6d4-03dc-4046-9079-c0464f5e8d66 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:22.475084 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:22.518990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8d8eb6d4-03dc-4046-9079-c0464f5e8d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e0384f004d42edbf85dfff88b750ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:22.526255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8d8eb6d4-03dc-4046-9079-c0464f5e8d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e0384f004d42edbf85dfff88b750ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:22.527012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8d8eb6d4-03dc-4046-9079-c0464f5e8d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e0384f004d42edbf85dfff88b750ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:22.527682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8d8eb6d4-03dc-4046-9079-c0464f5e8d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e0384f004d42edbf85dfff88b750ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:22.543394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8d8eb6d4-03dc-4046-9079-c0464f5e8d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e0384f004d42edbf85dfff88b750ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:22.558096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1299/2582] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:22 2022] DELETE /identity/v3/users/c6e0384f004d42edbf85dfff88b750ee => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:22.892510 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:22.894520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:22.914488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a32c56-2f47-44a8-95bc-a9387f8d454c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:22.921032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:22.982052 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:22.982928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:22.983220 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:22.983504 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] PATH_INFO: `/v3/projects/4121a01bccfa4c1b8922767fdb9e9bda` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:22.985021 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4121a01bccfa4c1b8922767fdb9e9bda)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:22.986834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.033404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4121a01bccfa4c1b8922767fdb9e9bda', 'request_id': 'req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:23.040066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4121a01bccfa4c1b8922767fdb9e9bda', 'request_id': 'req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:23.046141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4121a01bccfa4c1b8922767fdb9e9bda', 'request_id': 'req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:23.058274 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] The token cache is being invalidate because project 4121a01bccfa4c1b8922767fdb9e9bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:23.058577 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:23.059214 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d1e68cd9-2c96-4bb8-8884-67d8aad6d613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:23.060856 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1284/2583] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:22 2022] DELETE /identity/v3/projects/4121a01bccfa4c1b8922767fdb9e9bda => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:23.065788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375c70-ae74-47f7-96e9-f34d96bd82e3 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.066098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375c70-ae74-47f7-96e9-f34d96bd82e3 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.066367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375c70-ae74-47f7-96e9-f34d96bd82e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.085396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-10375c70-ae74-47f7-96e9-f34d96bd82e3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:23.086609 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-10375c70-ae74-47f7-96e9-f34d96bd82e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:23.146665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1300/2584] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:23.154229 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd95998-69a0-4b3f-887a-4decea8b533f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.154556 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd95998-69a0-4b3f-887a-4decea8b533f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.154878 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd95998-69a0-4b3f-887a-4decea8b533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.173872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-fcd95998-69a0-4b3f-887a-4decea8b533f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:23.175712 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fcd95998-69a0-4b3f-887a-4decea8b533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:23.183559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1285/2585] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:23.187896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375c70-ae74-47f7-96e9-f34d96bd82e3 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:23.199007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375c70-ae74-47f7-96e9-f34d96bd82e3 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.203808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50625a87-ca95-4068-9240-4f9f2c355399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.204465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625a87-ca95-4068-9240-4f9f2c355399 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.204795 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625a87-ca95-4068-9240-4f9f2c355399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.205070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625a87-ca95-4068-9240-4f9f2c355399 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.207110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50625a87-ca95-4068-9240-4f9f2c355399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:23.207422 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50625a87-ca95-4068-9240-4f9f2c355399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.209072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50625a87-ca95-4068-9240-4f9f2c355399 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.220856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1301/2586] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:20:23.226017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd95998-69a0-4b3f-887a-4decea8b533f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:23.235560 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd95998-69a0-4b3f-887a-4decea8b533f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.240973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413d2fe-b96b-46f3-ace0-7451add639a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.241631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413d2fe-b96b-46f3-ace0-7451add639a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.241946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413d2fe-b96b-46f3-ace0-7451add639a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.242228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413d2fe-b96b-46f3-ace0-7451add639a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.242929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413d2fe-b96b-46f3-ace0-7451add639a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.244857 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413d2fe-b96b-46f3-ace0-7451add639a7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.270728 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1286/2587] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:23 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:23.274916 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50625a87-ca95-4068-9240-4f9f2c355399 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:23.284877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50625a87-ca95-4068-9240-4f9f2c355399 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.341313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788e281-243f-4462-8d5e-e0aecd08cc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.341987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e281-243f-4462-8d5e-e0aecd08cc19 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.342277 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e281-243f-4462-8d5e-e0aecd08cc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.342559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e281-243f-4462-8d5e-e0aecd08cc19 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.343249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788e281-243f-4462-8d5e-e0aecd08cc19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.345246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788e281-243f-4462-8d5e-e0aecd08cc19 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.364066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1302/2588] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:23 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:20:23.368155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413d2fe-b96b-46f3-ace0-7451add639a7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:23.379018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413d2fe-b96b-46f3-ace0-7451add639a7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.383654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a9071-7f7b-4695-8c3f-fb3e8bf0cbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.384309 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a9071-7f7b-4695-8c3f-fb3e8bf0cbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.384599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a9071-7f7b-4695-8c3f-fb3e8bf0cbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.384915 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a9071-7f7b-4695-8c3f-fb3e8bf0cbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.385649 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a9071-7f7b-4695-8c3f-fb3e8bf0cbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.387242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a9071-7f7b-4695-8c3f-fb3e8bf0cbc3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.398187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1287/2589] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:23.401880 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788e281-243f-4462-8d5e-e0aecd08cc19 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:23.408139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:23.412140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788e281-243f-4462-8d5e-e0aecd08cc19 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.418388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e407c3-c173-4f3b-9185-781f56e6043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.419208 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e407c3-c173-4f3b-9185-781f56e6043d admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.419540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e407c3-c173-4f3b-9185-781f56e6043d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.419998 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e407c3-c173-4f3b-9185-781f56e6043d admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.420843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e407c3-c173-4f3b-9185-781f56e6043d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.422643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e407c3-c173-4f3b-9185-781f56e6043d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.432660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1303/2590] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:23.436781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a9071-7f7b-4695-8c3f-fb3e8bf0cbc3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:23.447097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a9071-7f7b-4695-8c3f-fb3e8bf0cbc3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.451938 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbdc13-0b97-4a8c-92be-9359c6abfb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.454015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbdc13-0b97-4a8c-92be-9359c6abfb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.454015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbdc13-0b97-4a8c-92be-9359c6abfb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.454015 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbdc13-0b97-4a8c-92be-9359c6abfb7e admin admin] PATH_INFO: `/v3/projects/88329882bc4a4c0b93b250ca7cf0b35e/users/71f5db6818be42e0974334849fe5640e/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.471456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbdc13-0b97-4a8c-92be-9359c6abfb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88329882bc4a4c0b93b250ca7cf0b35e, user_id=71f5db6818be42e0974334849fe5640e, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.474423 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbdc13-0b97-4a8c-92be-9359c6abfb7e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.489671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1288/2591] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:23 2022] PUT /identity/v3/projects/88329882bc4a4c0b93b250ca7cf0b35e/users/71f5db6818be42e0974334849fe5640e/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:23.500941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416cc7-e7db-446f-92ef-714fc01f2d79 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.501256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416cc7-e7db-446f-92ef-714fc01f2d79 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.501539 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416cc7-e7db-446f-92ef-714fc01f2d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.530022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e9416cc7-e7db-446f-92ef-714fc01f2d79 None None] MFA Rules not processed for user `71f5db6818be42e0974334849fe5640e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:23.531198 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e9416cc7-e7db-446f-92ef-714fc01f2d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:23.598801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1304/2592] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:23.603171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbdc13-0b97-4a8c-92be-9359c6abfb7e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:23.639084 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:23.668757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbdc13-0b97-4a8c-92be-9359c6abfb7e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.673356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a3027-e313-4f94-8f44-38e195974461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.674003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3027-e313-4f94-8f44-38e195974461 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.675236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3027-e313-4f94-8f44-38e195974461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.675521 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3027-e313-4f94-8f44-38e195974461 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.676200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a3027-e313-4f94-8f44-38e195974461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.678119 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a3027-e313-4f94-8f44-38e195974461 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.702835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1289/2593] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:23 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:23.707060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9416cc7-e7db-446f-92ef-714fc01f2d79 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:23.717705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9416cc7-e7db-446f-92ef-714fc01f2d79 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.780944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215ec10-cd52-403a-86aa-d916655412f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.781543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215ec10-cd52-403a-86aa-d916655412f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.781833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215ec10-cd52-403a-86aa-d916655412f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.782109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215ec10-cd52-403a-86aa-d916655412f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.782813 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215ec10-cd52-403a-86aa-d916655412f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.784821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215ec10-cd52-403a-86aa-d916655412f3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.808405 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1305/2594] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:23 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:23.811387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a3027-e313-4f94-8f44-38e195974461 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:23.822950 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a3027-e313-4f94-8f44-38e195974461 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.827825 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd8569-9b30-486f-80cc-145df2faff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.828882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8569-9b30-486f-80cc-145df2faff24 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.829292 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8569-9b30-486f-80cc-145df2faff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.829469 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8569-9b30-486f-80cc-145df2faff24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.830223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd8569-9b30-486f-80cc-145df2faff24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.831991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd8569-9b30-486f-80cc-145df2faff24 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.847671 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1290/2595] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:23.848773 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215ec10-cd52-403a-86aa-d916655412f3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:23.866285 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215ec10-cd52-403a-86aa-d916655412f3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.871355 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573413d8-eff8-4bd8-b2f1-e126f3c2b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.872340 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573413d8-eff8-4bd8-b2f1-e126f3c2b33c admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.872762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573413d8-eff8-4bd8-b2f1-e126f3c2b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.873134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573413d8-eff8-4bd8-b2f1-e126f3c2b33c admin admin] PATH_INFO: `/v3/projects/2dbcd06650eb4d879588c4be11890e20/users/ae64feab1a4c4538ac8613fea72ecb3b/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.889215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573413d8-eff8-4bd8-b2f1-e126f3c2b33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dbcd06650eb4d879588c4be11890e20, user_id=ae64feab1a4c4538ac8613fea72ecb3b, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.891842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573413d8-eff8-4bd8-b2f1-e126f3c2b33c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.906250 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1306/2596] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:23 2022] PUT /identity/v3/projects/2dbcd06650eb4d879588c4be11890e20/users/ae64feab1a4c4538ac8613fea72ecb3b/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:20:23.910708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd8569-9b30-486f-80cc-145df2faff24 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:23.921790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd8569-9b30-486f-80cc-145df2faff24 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:23.983266 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6f3cb-fc67-45f1-8bea-8299f4f11e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:23.983939 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f3cb-fc67-45f1-8bea-8299f4f11e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:23.984227 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f3cb-fc67-45f1-8bea-8299f4f11e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:23.984508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f3cb-fc67-45f1-8bea-8299f4f11e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:23.985272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6f3cb-fc67-45f1-8bea-8299f4f11e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:23.987585 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6f3cb-fc67-45f1-8bea-8299f4f11e51 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:23.997685 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1291/2597] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:24.001706 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573413d8-eff8-4bd8-b2f1-e126f3c2b33c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:24.012605 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573413d8-eff8-4bd8-b2f1-e126f3c2b33c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:24.017251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd9fc-2eab-417f-99ca-5aba888246e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:24.018317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd9fc-2eab-417f-99ca-5aba888246e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:24.018596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd9fc-2eab-417f-99ca-5aba888246e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:24.018870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd9fc-2eab-417f-99ca-5aba888246e0 admin admin] PATH_INFO: `/v3/projects/2dbcd06650eb4d879588c4be11890e20/users/ae64feab1a4c4538ac8613fea72ecb3b/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:24.020890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dd9fc-2eab-417f-99ca-5aba888246e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dbcd06650eb4d879588c4be11890e20, user_id=ae64feab1a4c4538ac8613fea72ecb3b, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:24.023531 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dd9fc-2eab-417f-99ca-5aba888246e0 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:24.034199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1307/2598] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:24 2022] PUT /identity/v3/projects/2dbcd06650eb4d879588c4be11890e20/users/ae64feab1a4c4538ac8613fea72ecb3b/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:24.044761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9e14a-0e48-4f22-82f7-5e6e4ed16958 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:24.045062 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9e14a-0e48-4f22-82f7-5e6e4ed16958 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:24.045353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9e14a-0e48-4f22-82f7-5e6e4ed16958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:24.072222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d9a9e14a-0e48-4f22-82f7-5e6e4ed16958 None None] MFA Rules not processed for user `ae64feab1a4c4538ac8613fea72ecb3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:24.073466 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d9a9e14a-0e48-4f22-82f7-5e6e4ed16958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:24.141614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1292/2599] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:24.152525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd9fc-2eab-417f-99ca-5aba888246e0 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:24.154288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-941dd9fc-2eab-417f-99ca-5aba888246e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:24.195427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:24.218086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd9fc-2eab-417f-99ca-5aba888246e0 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:24.223351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0d72-0575-45cd-b4b4-34929459637a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:24.224021 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0d72-0575-45cd-b4b4-34929459637a service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:24.224370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0d72-0575-45cd-b4b4-34929459637a service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:24.224685 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0d72-0575-45cd-b4b4-34929459637a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:24.287012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0d72-0575-45cd-b4b4-34929459637a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:24.288522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0d72-0575-45cd-b4b4-34929459637a service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:24.298053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1308/2600] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:28.496045 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9e14a-0e48-4f22-82f7-5e6e4ed16958 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:28.497578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d9a9e14a-0e48-4f22-82f7-5e6e4ed16958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:28.510727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9e14a-0e48-4f22-82f7-5e6e4ed16958 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:28.514241 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeb4fd-461a-4c35-a4a5-93f43fcee8ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:28.514873 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb4fd-461a-4c35-a4a5-93f43fcee8ac service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:28.515155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb4fd-461a-4c35-a4a5-93f43fcee8ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:28.515429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb4fd-461a-4c35-a4a5-93f43fcee8ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:28.524727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aeb4fd-461a-4c35-a4a5-93f43fcee8ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:28.526143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aeb4fd-461a-4c35-a4a5-93f43fcee8ac service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:28.536627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1293/2601] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:33.454373 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0d72-0575-45cd-b4b4-34929459637a service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:33.522692 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0d72-0575-45cd-b4b4-34929459637a service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:33.527532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:33.528405 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:33.528716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:33.528992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] PATH_INFO: `/v3/users/71f5db6818be42e0974334849fe5640e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:33.530172 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f5db6818be42e0974334849fe5640e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:33.532448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:33.584966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f5db6818be42e0974334849fe5640e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:33.591856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f5db6818be42e0974334849fe5640e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:33.592527 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f5db6818be42e0974334849fe5640e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:33.593155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f5db6818be42e0974334849fe5640e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:33.606885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f5db6818be42e0974334849fe5640e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:33.620059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1309/2602] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:33 2022] DELETE /identity/v3/users/71f5db6818be42e0974334849fe5640e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:33.625181 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86968e-feb4-4d78-8698-521348b57968 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:33.625999 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86968e-feb4-4d78-8698-521348b57968 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:33.626969 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86968e-feb4-4d78-8698-521348b57968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:33.647282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0b86968e-feb4-4d78-8698-521348b57968 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:33.648571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0b86968e-feb4-4d78-8698-521348b57968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:33.658287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:33.711909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1294/2603] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:33.722725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:33.724313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:33.736135 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:33.788986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdf292-87e8-48ce-b3e3-840daff1bf2d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:33.792946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ca4f8-0218-4d85-a388-1b7b8b701b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:33.793602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca4f8-0218-4d85-a388-1b7b8b701b5e service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:33.793886 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca4f8-0218-4d85-a388-1b7b8b701b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:33.794160 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca4f8-0218-4d85-a388-1b7b8b701b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:33.803727 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ca4f8-0218-4d85-a388-1b7b8b701b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:33.805286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ca4f8-0218-4d85-a388-1b7b8b701b5e service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:33.815306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1310/2604] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:33.950065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d19f3-29e1-4b5f-a161-5c3324d86d54 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:33.950367 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d19f3-29e1-4b5f-a161-5c3324d86d54 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:33.950655 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d19f3-29e1-4b5f-a161-5c3324d86d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:33.978689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6c9d19f3-29e1-4b5f-a161-5c3324d86d54 None None] MFA Rules not processed for user `21d8d5c8b45d4d15a60a66b955dc9617`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:33.979894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6c9d19f3-29e1-4b5f-a161-5c3324d86d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:34.037026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1295/2605] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:34.087017 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ca4f8-0218-4d85-a388-1b7b8b701b5e service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:34.088586 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3a4ca4f8-0218-4d85-a388-1b7b8b701b5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:34.109895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ca4f8-0218-4d85-a388-1b7b8b701b5e service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:34.116000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:34.117164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:34.117675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:34.118024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] PATH_INFO: `/v3/projects/88329882bc4a4c0b93b250ca7cf0b35e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:34.119588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88329882bc4a4c0b93b250ca7cf0b35e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:34.121584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:34.173153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88329882bc4a4c0b93b250ca7cf0b35e', 'request_id': 'req-17e6bd76-10fd-4754-bb86-063176899e02'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:34.181064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88329882bc4a4c0b93b250ca7cf0b35e', 'request_id': 'req-17e6bd76-10fd-4754-bb86-063176899e02'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:34.189441 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88329882bc4a4c0b93b250ca7cf0b35e', 'request_id': 'req-17e6bd76-10fd-4754-bb86-063176899e02'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:34.202804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] The token cache is being invalidate because project 88329882bc4a4c0b93b250ca7cf0b35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:34.203093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:34.203805 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:34.206007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1311/2606] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:34 2022] DELETE /identity/v3/projects/88329882bc4a4c0b93b250ca7cf0b35e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:34.210154 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d19f3-29e1-4b5f-a161-5c3324d86d54 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:34.222092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d19f3-29e1-4b5f-a161-5c3324d86d54 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:34.289609 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd037d5-0d43-4076-9c4c-599a7c56eac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:34.290807 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd037d5-0d43-4076-9c4c-599a7c56eac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:34.291105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd037d5-0d43-4076-9c4c-599a7c56eac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:34.291450 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd037d5-0d43-4076-9c4c-599a7c56eac6 admin admin] PATH_INFO: `/v3/users/ae64feab1a4c4538ac8613fea72ecb3b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:34.292641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd037d5-0d43-4076-9c4c-599a7c56eac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae64feab1a4c4538ac8613fea72ecb3b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:34.294599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd037d5-0d43-4076-9c4c-599a7c56eac6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:34.360701 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cdd037d5-0d43-4076-9c4c-599a7c56eac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae64feab1a4c4538ac8613fea72ecb3b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:34.370131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cdd037d5-0d43-4076-9c4c-599a7c56eac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae64feab1a4c4538ac8613fea72ecb3b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:34.370900 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cdd037d5-0d43-4076-9c4c-599a7c56eac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae64feab1a4c4538ac8613fea72ecb3b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:34.371627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cdd037d5-0d43-4076-9c4c-599a7c56eac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae64feab1a4c4538ac8613fea72ecb3b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:34.381184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:34.394179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cdd037d5-0d43-4076-9c4c-599a7c56eac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae64feab1a4c4538ac8613fea72ecb3b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:34.416132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1296/2607] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:34 2022] DELETE /identity/v3/users/ae64feab1a4c4538ac8613fea72ecb3b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:34.916379 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:34.917971 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:34.934559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6bd76-10fd-4754-bb86-063176899e02 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:35.007076 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:35.008256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.008554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.008867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] PATH_INFO: `/v3/projects/2dbcd06650eb4d879588c4be11890e20` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.010096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dbcd06650eb4d879588c4be11890e20)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:35.012162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:35.069939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:35.082815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dbcd06650eb4d879588c4be11890e20', 'request_id': 'req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:35.089587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dbcd06650eb4d879588c4be11890e20', 'request_id': 'req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:35.098610 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dbcd06650eb4d879588c4be11890e20', 'request_id': 'req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:35.109697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] The token cache is being invalidate because project 2dbcd06650eb4d879588c4be11890e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:35.111354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:35.112594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-9d23330f-4fbb-4dcc-8b49-5d25c60d77a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:35.117125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1312/2608] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:34 2022] DELETE /identity/v3/projects/2dbcd06650eb4d879588c4be11890e20 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:35.122412 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ee30-aebd-4d08-98a3-946d15a7ac04 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.123478 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ee30-aebd-4d08-98a3-946d15a7ac04 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.123831 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ee30-aebd-4d08-98a3-946d15a7ac04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.150300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c332ee30-aebd-4d08-98a3-946d15a7ac04 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:35.151798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c332ee30-aebd-4d08-98a3-946d15a7ac04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:35.232289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1297/2609] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:35.241361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4926f8-8f24-453c-a539-1def49f058c8 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.241656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4926f8-8f24-453c-a539-1def49f058c8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.241951 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4926f8-8f24-453c-a539-1def49f058c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.263268 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ad4926f8-8f24-453c-a539-1def49f058c8 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:35.264525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ad4926f8-8f24-453c-a539-1def49f058c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:35.272925 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1313/2610] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:35.277226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332ee30-aebd-4d08-98a3-946d15a7ac04 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:35.287716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332ee30-aebd-4d08-98a3-946d15a7ac04 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:35.292554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a89432-e27e-49fc-b076-c4d22bbb90ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:35.293264 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a89432-e27e-49fc-b076-c4d22bbb90ed admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.293557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a89432-e27e-49fc-b076-c4d22bbb90ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.293836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a89432-e27e-49fc-b076-c4d22bbb90ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.294690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a89432-e27e-49fc-b076-c4d22bbb90ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:20:35.295005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a89432-e27e-49fc-b076-c4d22bbb90ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:35.296624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a89432-e27e-49fc-b076-c4d22bbb90ed admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:35.309024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1298/2611] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:20:35.313485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4926f8-8f24-453c-a539-1def49f058c8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:35.323253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4926f8-8f24-453c-a539-1def49f058c8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:35.327972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad582185-f975-4a6c-bfd4-59904b4e12af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:35.328731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad582185-f975-4a6c-bfd4-59904b4e12af admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.329083 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad582185-f975-4a6c-bfd4-59904b4e12af admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.329434 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad582185-f975-4a6c-bfd4-59904b4e12af admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.330226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad582185-f975-4a6c-bfd4-59904b4e12af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:35.332345 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad582185-f975-4a6c-bfd4-59904b4e12af admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:35.358988 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1314/2612] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:20:35 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:35.363980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a89432-e27e-49fc-b076-c4d22bbb90ed admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:35.374373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a89432-e27e-49fc-b076-c4d22bbb90ed admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:35.433904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0e78e-37f4-4fd4-9e70-39330e05c2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:35.434575 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0e78e-37f4-4fd4-9e70-39330e05c2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.434881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0e78e-37f4-4fd4-9e70-39330e05c2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.435143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0e78e-37f4-4fd4-9e70-39330e05c2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.435839 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0e78e-37f4-4fd4-9e70-39330e05c2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:35.437768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0e78e-37f4-4fd4-9e70-39330e05c2f0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:35.460556 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1299/2613] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:20:35 2022] POST /identity/v3/users => generated 281 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:20:35.464711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad582185-f975-4a6c-bfd4-59904b4e12af admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:35.476568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad582185-f975-4a6c-bfd4-59904b4e12af admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:35.482262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932f277-918f-419d-bd3d-1961a6227051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:35.483128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932f277-918f-419d-bd3d-1961a6227051 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.483432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932f277-918f-419d-bd3d-1961a6227051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.483696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932f277-918f-419d-bd3d-1961a6227051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.484441 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932f277-918f-419d-bd3d-1961a6227051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:35.486165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932f277-918f-419d-bd3d-1961a6227051 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:35.499546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1315/2614] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:35.501909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0e78e-37f4-4fd4-9e70-39330e05c2f0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:35.512061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0e78e-37f4-4fd4-9e70-39330e05c2f0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:35.516827 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc1b53-bb2d-4cd5-b1df-716f844bd37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:35.517503 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc1b53-bb2d-4cd5-b1df-716f844bd37f admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.517823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc1b53-bb2d-4cd5-b1df-716f844bd37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.518108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc1b53-bb2d-4cd5-b1df-716f844bd37f admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.518845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc1b53-bb2d-4cd5-b1df-716f844bd37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:35.520433 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc1b53-bb2d-4cd5-b1df-716f844bd37f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:35.530578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1300/2615] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:20:35.537508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932f277-918f-419d-bd3d-1961a6227051 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:35.547803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932f277-918f-419d-bd3d-1961a6227051 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:35.553493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e0163-6497-4b62-88a2-cec81be0b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:35.554378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e0163-6497-4b62-88a2-cec81be0b97e admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.554663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e0163-6497-4b62-88a2-cec81be0b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.554936 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e0163-6497-4b62-88a2-cec81be0b97e admin admin] PATH_INFO: `/v3/projects/3fce9fdd706c4cd1bd65ca41281f21f3/users/91f3623946434536aaf42c5f9c336961/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.570684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e0163-6497-4b62-88a2-cec81be0b97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fce9fdd706c4cd1bd65ca41281f21f3, user_id=91f3623946434536aaf42c5f9c336961, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:35.573467 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e0163-6497-4b62-88a2-cec81be0b97e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:35.587004 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1316/2616] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:20:35 2022] PUT /identity/v3/projects/3fce9fdd706c4cd1bd65ca41281f21f3/users/91f3623946434536aaf42c5f9c336961/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:35.599848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840c361-14a2-43de-9603-8cefa529e3bd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.600180 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840c361-14a2-43de-9603-8cefa529e3bd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.600459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840c361-14a2-43de-9603-8cefa529e3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.631737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4840c361-14a2-43de-9603-8cefa529e3bd None None] MFA Rules not processed for user `91f3623946434536aaf42c5f9c336961`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:35.633026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4840c361-14a2-43de-9603-8cefa529e3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:35.669396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:35.705116 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1301/2617] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:20:35.738687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e0163-6497-4b62-88a2-cec81be0b97e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:35.740418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f88e0163-6497-4b62-88a2-cec81be0b97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:35.809577 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e0163-6497-4b62-88a2-cec81be0b97e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:35.811664 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38e0c8-c852-4027-8cdc-90e8e8caefec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:35.812120 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e0c8-c852-4027-8cdc-90e8e8caefec service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.812369 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e0c8-c852-4027-8cdc-90e8e8caefec service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.812700 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e0c8-c852-4027-8cdc-90e8e8caefec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.822570 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38e0c8-c852-4027-8cdc-90e8e8caefec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:35.824014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38e0c8-c852-4027-8cdc-90e8e8caefec service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:35.835448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1317/2618] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:35.852906 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840c361-14a2-43de-9603-8cefa529e3bd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:35.930921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840c361-14a2-43de-9603-8cefa529e3bd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:35.936195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bbdee-4047-40c3-9909-4060e950a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:35.937144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bbdee-4047-40c3-9909-4060e950a71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:35.937428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bbdee-4047-40c3-9909-4060e950a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:35.937830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bbdee-4047-40c3-9909-4060e950a71a admin admin] PATH_INFO: `/v3/users/91f3623946434536aaf42c5f9c336961` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:35.939126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bbdee-4047-40c3-9909-4060e950a71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f3623946434536aaf42c5f9c336961)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:35.942533 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bbdee-4047-40c3-9909-4060e950a71a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:36.008785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38e0c8-c852-4027-8cdc-90e8e8caefec service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:36.010281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3a38e0c8-c852-4027-8cdc-90e8e8caefec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:36.062650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0a6bbdee-4047-40c3-9909-4060e950a71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f3623946434536aaf42c5f9c336961'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:36.078327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0a6bbdee-4047-40c3-9909-4060e950a71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f3623946434536aaf42c5f9c336961'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:36.079598 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0a6bbdee-4047-40c3-9909-4060e950a71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f3623946434536aaf42c5f9c336961'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:36.082291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0a6bbdee-4047-40c3-9909-4060e950a71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f3623946434536aaf42c5f9c336961'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:36.110046 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0a6bbdee-4047-40c3-9909-4060e950a71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f3623946434536aaf42c5f9c336961'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:36.132126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1302/2619] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:20:35 2022] DELETE /identity/v3/users/91f3623946434536aaf42c5f9c336961 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:36.136211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38e0c8-c852-4027-8cdc-90e8e8caefec service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:36.138656 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42fe90-0d30-4490-bfcb-df4b334b140d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:36.138983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42fe90-0d30-4490-bfcb-df4b334b140d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:36.139326 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42fe90-0d30-4490-bfcb-df4b334b140d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:36.170090 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:36.180850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1c42fe90-0d30-4490-bfcb-df4b334b140d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:36.182120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1c42fe90-0d30-4490-bfcb-df4b334b140d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:36.219810 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e4057-f579-4c8d-a4a0-c36794023113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:36.220390 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4057-f579-4c8d-a4a0-c36794023113 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:36.220709 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4057-f579-4c8d-a4a0-c36794023113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:36.227716 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4057-f579-4c8d-a4a0-c36794023113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:36.230841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-253e4057-f579-4c8d-a4a0-c36794023113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:36.259430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e4057-f579-4c8d-a4a0-c36794023113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:36.261987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e4057-f579-4c8d-a4a0-c36794023113 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:36.280022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1318/2620] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:20:36.304371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:36.330358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1303/2621] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:36.351834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e4057-f579-4c8d-a4a0-c36794023113 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:36.354059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-253e4057-f579-4c8d-a4a0-c36794023113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:36.393173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e4057-f579-4c8d-a4a0-c36794023113 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:36.400566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac42221-65d4-4421-8d9b-14d0cf200ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:36.401253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac42221-65d4-4421-8d9b-14d0cf200ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:36.401535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac42221-65d4-4421-8d9b-14d0cf200ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:36.401840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac42221-65d4-4421-8d9b-14d0cf200ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:36.414166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac42221-65d4-4421-8d9b-14d0cf200ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:36.416395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac42221-65d4-4421-8d9b-14d0cf200ba9 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:36.434848 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1319/2622] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:36.470141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5769-067b-4186-b7f7-1fd5383f06ae None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:36.470341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5769-067b-4186-b7f7-1fd5383f06ae None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:36.470625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5769-067b-4186-b7f7-1fd5383f06ae None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:36.473718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1304/2623] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:20:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:20:36.498256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e30d4-3cd0-48e2-84ba-a367989c3e3b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:36.498809 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e30d4-3cd0-48e2-84ba-a367989c3e3b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:36.499252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e30d4-3cd0-48e2-84ba-a367989c3e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:36.527537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e30e30d4-3cd0-48e2-84ba-a367989c3e3b None None] MFA Rules not processed for user `9d21089ce5b140ab9549816b8cb38316`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:36.529342 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e30e30d4-3cd0-48e2-84ba-a367989c3e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:36.544708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1320/2624] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:20:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:36.566223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a5769-067b-4186-b7f7-1fd5383f06ae None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:36.586201 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a5769-067b-4186-b7f7-1fd5383f06ae None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:36.590916 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae92488-f702-4390-b287-34127b9d7838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:36.591993 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92488-f702-4390-b287-34127b9d7838 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:36.592285 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92488-f702-4390-b287-34127b9d7838 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:36.592563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92488-f702-4390-b287-34127b9d7838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:36.606872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae92488-f702-4390-b287-34127b9d7838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:36.609099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae92488-f702-4390-b287-34127b9d7838 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:36.625567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1305/2625] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:36.778895 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e329-dd89-4f25-a0f1-2487efb52df9 None None] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:36.779189 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e329-dd89-4f25-a0f1-2487efb52df9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:36.779468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e329-dd89-4f25-a0f1-2487efb52df9 None None] PATH_INFO: `/` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:36.781067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1321/2626] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jun 20 06:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:20:36.791177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da6532-7cc1-40ab-a3ee-ac3131e2c673 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:36.791663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da6532-7cc1-40ab-a3ee-ac3131e2c673 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:36.791953 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da6532-7cc1-40ab-a3ee-ac3131e2c673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:36.825047 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a1da6532-7cc1-40ab-a3ee-ac3131e2c673 None None] MFA Rules not processed for user `3748d8369d20429eb2376ce02d42eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:36.826306 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a1da6532-7cc1-40ab-a3ee-ac3131e2c673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:36.944024 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1306/2627] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jun 20 06:20:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:36.954369 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3e329-dd89-4f25-a0f1-2487efb52df9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:36.957134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1de3e329-dd89-4f25-a0f1-2487efb52df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:36.963631 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da6532-7cc1-40ab-a3ee-ac3131e2c673 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:36.974726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da6532-7cc1-40ab-a3ee-ac3131e2c673 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:36.975406 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3e329-dd89-4f25-a0f1-2487efb52df9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:36.980131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22468410-3273-4c3a-ab54-e619df650c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:36.980353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22468410-3273-4c3a-ab54-e619df650c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:36.980552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22468410-3273-4c3a-ab54-e619df650c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:36.980955 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22468410-3273-4c3a-ab54-e619df650c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:36.983140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:36.984314 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:36.984752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:36.985185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] PATH_INFO: `/v3/projects/3fce9fdd706c4cd1bd65ca41281f21f3` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:36.986545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fce9fdd706c4cd1bd65ca41281f21f3)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:36.988760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:36.994202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22468410-3273-4c3a-ab54-e619df650c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:36.995910 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22468410-3273-4c3a-ab54-e619df650c1a service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:37.008809 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1307/2628] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:20:37.043918 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fce9fdd706c4cd1bd65ca41281f21f3', 'request_id': 'req-451668eb-8433-4d8d-a130-650abc4da7f3'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:37.050344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fce9fdd706c4cd1bd65ca41281f21f3', 'request_id': 'req-451668eb-8433-4d8d-a130-650abc4da7f3'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:37.059212 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fce9fdd706c4cd1bd65ca41281f21f3', 'request_id': 'req-451668eb-8433-4d8d-a130-650abc4da7f3'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:37.071451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] The token cache is being invalidate because project 3fce9fdd706c4cd1bd65ca41281f21f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:20:37.071794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:37.073059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-451668eb-8433-4d8d-a130-650abc4da7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:20:37.074856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1322/2629] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:20:36 2022] DELETE /identity/v3/projects/3fce9fdd706c4cd1bd65ca41281f21f3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:20:38.118407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22468410-3273-4c3a-ab54-e619df650c1a service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:38.119964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-22468410-3273-4c3a-ab54-e619df650c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:38.137526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22468410-3273-4c3a-ab54-e619df650c1a service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:38.246089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e36f63-1d66-4789-9163-2ffcc035dd1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:38.247126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36f63-1d66-4789-9163-2ffcc035dd1c service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:38.247419 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36f63-1d66-4789-9163-2ffcc035dd1c service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:38.247847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36f63-1d66-4789-9163-2ffcc035dd1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:38.250473 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d3e36f63-1d66-4789-9163-2ffcc035dd1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:38.293830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e36f63-1d66-4789-9163-2ffcc035dd1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:38.312692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e36f63-1d66-4789-9163-2ffcc035dd1c service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:38.342371 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1308/2630] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:20:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:20:44.803944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ed0e2-7c15-4518-9b17-c421ab046cfa None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:44.804543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ed0e2-7c15-4518-9b17-c421ab046cfa None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:44.804543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ed0e2-7c15-4518-9b17-c421ab046cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:44.823736 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5e6ed0e2-7c15-4518-9b17-c421ab046cfa None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:20:44.824986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5e6ed0e2-7c15-4518-9b17-c421ab046cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:44.889860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1323/2631] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:20:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:20:44.949415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e36f63-1d66-4789-9163-2ffcc035dd1c service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:20:44.950975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d3e36f63-1d66-4789-9163-2ffcc035dd1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:20:45.011446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:45.032850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e36f63-1d66-4789-9163-2ffcc035dd1c service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:20:45.038389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b9118-f734-4e28-89db-d14368073a5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:20:45.039043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b9118-f734-4e28-89db-d14368073a5a service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:20:45.039332 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b9118-f734-4e28-89db-d14368073a5a service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:20:45.039615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b9118-f734-4e28-89db-d14368073a5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:20:45.047964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b9118-f734-4e28-89db-d14368073a5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:20:45.050290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b9118-f734-4e28-89db-d14368073a5a service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:20:45.058270 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1309/2632] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:20:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:20:54.882922 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:55.055043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=11 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:00.839397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee4f8f-ceb5-4bc0-8a1a-8720634c53c1 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:00.839891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee4f8f-ceb5-4bc0-8a1a-8720634c53c1 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:00.840008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee4f8f-ceb5-4bc0-8a1a-8720634c53c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:00.858147 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-0dee4f8f-ceb5-4bc0-8a1a-8720634c53c1 None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:00.859331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0dee4f8f-ceb5-4bc0-8a1a-8720634c53c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:00.867761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1324/2633] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jun 20 06:21:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:00.879517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b9118-f734-4e28-89db-d14368073a5a service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:00.889932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b9118-f734-4e28-89db-d14368073a5a service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:00.895202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68c7a7-4ba5-4061-8e55-3f313067188f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:00.895835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c7a7-4ba5-4061-8e55-3f313067188f service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:00.896121 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c7a7-4ba5-4061-8e55-3f313067188f service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:00.903480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c7a7-4ba5-4061-8e55-3f313067188f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:00.921633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68c7a7-4ba5-4061-8e55-3f313067188f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:00.923241 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68c7a7-4ba5-4061-8e55-3f313067188f service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:00.933195 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1310/2634] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:21:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:10.853002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:10.929354 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:17.214403 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca4ba9-afa4-4f4f-b988-d3fc3f375438 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:17.214890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca4ba9-afa4-4f4f-b988-d3fc3f375438 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:17.215000 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca4ba9-afa4-4f4f-b988-d3fc3f375438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:17.235257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-54ca4ba9-afa4-4f4f-b988-d3fc3f375438 None None] MFA Rules not processed for user `6c8e272684d542caaaecce191467edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:21:17.236450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-54ca4ba9-afa4-4f4f-b988-d3fc3f375438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:17.243821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1325/2635] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jun 20 06:21:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:21:17.256530 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68c7a7-4ba5-4061-8e55-3f313067188f service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:17.267297 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68c7a7-4ba5-4061-8e55-3f313067188f service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:17.273152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f573158-9956-4b56-b6ef-9a03caa40ac7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aadba0174824781b1866da7ba39956e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:17.273895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f573158-9956-4b56-b6ef-9a03caa40ac7 service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:17.274187 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f573158-9956-4b56-b6ef-9a03caa40ac7 service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:17.274468 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f573158-9956-4b56-b6ef-9a03caa40ac7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:17.282753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f573158-9956-4b56-b6ef-9a03caa40ac7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:17.284324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f573158-9956-4b56-b6ef-9a03caa40ac7 service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:17.292554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1311/2636] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jun 20 06:21:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:17.654407 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca4ba9-afa4-4f4f-b988-d3fc3f375438 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:17.655830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-54ca4ba9-afa4-4f4f-b988-d3fc3f375438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:17.728794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca4ba9-afa4-4f4f-b988-d3fc3f375438 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:17.733937 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979479a7-a82b-4e96-b79d-fdb233f61ac3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:17.734870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979479a7-a82b-4e96-b79d-fdb233f61ac3 service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:17.735159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979479a7-a82b-4e96-b79d-fdb233f61ac3 service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:17.735445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979479a7-a82b-4e96-b79d-fdb233f61ac3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:17.737277 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-979479a7-a82b-4e96-b79d-fdb233f61ac3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:17.752414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979479a7-a82b-4e96-b79d-fdb233f61ac3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:17.754854 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979479a7-a82b-4e96-b79d-fdb233f61ac3 service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:17.765946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1326/2637] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:27.289161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:27.761226 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=35 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:19.883911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f573158-9956-4b56-b6ef-9a03caa40ac7 service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:19.887101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0f573158-9956-4b56-b6ef-9a03caa40ac7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:19.944087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f573158-9956-4b56-b6ef-9a03caa40ac7 service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:19.947932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8023857-384a-43dd-ba27-3d0a495975ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:19.948724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8023857-384a-43dd-ba27-3d0a495975ad service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:19.949051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8023857-384a-43dd-ba27-3d0a495975ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:19.949368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8023857-384a-43dd-ba27-3d0a495975ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:19.952667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d8023857-384a-43dd-ba27-3d0a495975ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:20.026995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8023857-384a-43dd-ba27-3d0a495975ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:20.029627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8023857-384a-43dd-ba27-3d0a495975ad service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:20.039440 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1312/2638] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:23.205008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979479a7-a82b-4e96-b79d-fdb233f61ac3 service placement] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.206607 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-979479a7-a82b-4e96-b79d-fdb233f61ac3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:23.221963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979479a7-a82b-4e96-b79d-fdb233f61ac3 service placement] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.227958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020e452-7555-4973-9eca-214974009265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.229253 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020e452-7555-4973-9eca-214974009265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.229715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020e452-7555-4973-9eca-214974009265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.232979 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020e452-7555-4973-9eca-214974009265 admin admin] PATH_INFO: `/v3/users/21d8d5c8b45d4d15a60a66b955dc9617` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.234332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020e452-7555-4973-9eca-214974009265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d8d5c8b45d4d15a60a66b955dc9617)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.236267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020e452-7555-4973-9eca-214974009265 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.290885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3020e452-7555-4973-9eca-214974009265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d8d5c8b45d4d15a60a66b955dc9617'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:23.300102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3020e452-7555-4973-9eca-214974009265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d8d5c8b45d4d15a60a66b955dc9617'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:23.300831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3020e452-7555-4973-9eca-214974009265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d8d5c8b45d4d15a60a66b955dc9617'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:23.301505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3020e452-7555-4973-9eca-214974009265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d8d5c8b45d4d15a60a66b955dc9617'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:23.317211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3020e452-7555-4973-9eca-214974009265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d8d5c8b45d4d15a60a66b955dc9617'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:23.332207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1327/2639] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:23 2022] DELETE /identity/v3/users/21d8d5c8b45d4d15a60a66b955dc9617 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:23.503720 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8023857-384a-43dd-ba27-3d0a495975ad service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.514589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8023857-384a-43dd-ba27-3d0a495975ad service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.579438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.580294 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.580582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.580892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] PATH_INFO: `/v3/projects/c939b83bd07b4b72a1820e8f0b1de511` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.582152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c939b83bd07b4b72a1820e8f0b1de511)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.584048 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.630225 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c939b83bd07b4b72a1820e8f0b1de511', 'request_id': 'req-2fd53a8d-03c8-483f-8195-662563fd8a72'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:23.632079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:23.638404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c939b83bd07b4b72a1820e8f0b1de511', 'request_id': 'req-2fd53a8d-03c8-483f-8195-662563fd8a72'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:23.643991 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c939b83bd07b4b72a1820e8f0b1de511', 'request_id': 'req-2fd53a8d-03c8-483f-8195-662563fd8a72'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:23.655847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] The token cache is being invalidate because project c939b83bd07b4b72a1820e8f0b1de511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:23.656141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:23.656818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd53a8d-03c8-483f-8195-662563fd8a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:23.658449 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1313/2640] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:23 2022] DELETE /identity/v3/projects/c939b83bd07b4b72a1820e8f0b1de511 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:23.663318 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8ee97-4db1-4572-a146-f3d70b80bb96 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.663613 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8ee97-4db1-4572-a146-f3d70b80bb96 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.663898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8ee97-4db1-4572-a146-f3d70b80bb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.682538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-25e8ee97-4db1-4572-a146-f3d70b80bb96 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:23.683721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-25e8ee97-4db1-4572-a146-f3d70b80bb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:23.743197 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1328/2641] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:23.752011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45e486-6e99-4e58-b1eb-1c0549a482b3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.752304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45e486-6e99-4e58-b1eb-1c0549a482b3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.752584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45e486-6e99-4e58-b1eb-1c0549a482b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.770555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-dc45e486-6e99-4e58-b1eb-1c0549a482b3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:23.771750 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-dc45e486-6e99-4e58-b1eb-1c0549a482b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:23.779882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1314/2642] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:23.784058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8ee97-4db1-4572-a146-f3d70b80bb96 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.794425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8ee97-4db1-4572-a146-f3d70b80bb96 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.799232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a035-68f3-4150-9e35-9fc7121f585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.799881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a035-68f3-4150-9e35-9fc7121f585f admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.800164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a035-68f3-4150-9e35-9fc7121f585f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.800440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a035-68f3-4150-9e35-9fc7121f585f admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.801204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017a035-68f3-4150-9e35-9fc7121f585f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:23.801515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017a035-68f3-4150-9e35-9fc7121f585f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.803125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017a035-68f3-4150-9e35-9fc7121f585f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.815690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1329/2643] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:23.820128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45e486-6e99-4e58-b1eb-1c0549a482b3 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.829710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45e486-6e99-4e58-b1eb-1c0549a482b3 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.834250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a0499-0732-4751-96d6-02d238aeffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.834895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a0499-0732-4751-96d6-02d238aeffe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.835176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a0499-0732-4751-96d6-02d238aeffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.835451 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a0499-0732-4751-96d6-02d238aeffe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.836129 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a0499-0732-4751-96d6-02d238aeffe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.838044 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a0499-0732-4751-96d6-02d238aeffe5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.863588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1315/2644] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:23 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:23.867665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a035-68f3-4150-9e35-9fc7121f585f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.878212 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a035-68f3-4150-9e35-9fc7121f585f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.936863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19bab-288d-4234-92b3-fba0b7c6f8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.937517 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19bab-288d-4234-92b3-fba0b7c6f8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.937801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19bab-288d-4234-92b3-fba0b7c6f8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.938080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19bab-288d-4234-92b3-fba0b7c6f8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.938761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b19bab-288d-4234-92b3-fba0b7c6f8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.940693 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b19bab-288d-4234-92b3-fba0b7c6f8c4 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.947122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:23.962792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1330/2645] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:23 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:23.966952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a0499-0732-4751-96d6-02d238aeffe5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:23.977231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a0499-0732-4751-96d6-02d238aeffe5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:23.982713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814027fc-8472-4e50-a47a-8173760e66a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:23.983365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814027fc-8472-4e50-a47a-8173760e66a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:23.983652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814027fc-8472-4e50-a47a-8173760e66a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:23.983937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814027fc-8472-4e50-a47a-8173760e66a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:23.984691 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814027fc-8472-4e50-a47a-8173760e66a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:23.986290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814027fc-8472-4e50-a47a-8173760e66a5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:23.996532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1316/2646] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:24.001122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19bab-288d-4234-92b3-fba0b7c6f8c4 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:24.011023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19bab-288d-4234-92b3-fba0b7c6f8c4 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:24.015905 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f085ae-b785-4d45-82a6-e997422cb552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:24.016560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f085ae-b785-4d45-82a6-e997422cb552 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:24.016896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f085ae-b785-4d45-82a6-e997422cb552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:24.017179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f085ae-b785-4d45-82a6-e997422cb552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:24.017906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f085ae-b785-4d45-82a6-e997422cb552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:24.019536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f085ae-b785-4d45-82a6-e997422cb552 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:24.029327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1331/2647] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:24.033282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814027fc-8472-4e50-a47a-8173760e66a5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:24.043435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814027fc-8472-4e50-a47a-8173760e66a5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:24.048812 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8e228-1343-44f9-8d8b-50722bf2cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:24.049737 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8e228-1343-44f9-8d8b-50722bf2cd19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:24.050029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8e228-1343-44f9-8d8b-50722bf2cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:24.050307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8e228-1343-44f9-8d8b-50722bf2cd19 admin admin] PATH_INFO: `/v3/projects/7e2ff4217f0946b4ac8a6c4386e3984c/users/e13f49bfa5554e05aed015de2882c22a/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:24.065733 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8e228-1343-44f9-8d8b-50722bf2cd19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2ff4217f0946b4ac8a6c4386e3984c, user_id=e13f49bfa5554e05aed015de2882c22a, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:24.068358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8e228-1343-44f9-8d8b-50722bf2cd19 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:24.081299 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1317/2648] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:24 2022] PUT /identity/v3/projects/7e2ff4217f0946b4ac8a6c4386e3984c/users/e13f49bfa5554e05aed015de2882c22a/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:24.091655 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ccb1c-cce8-497e-8666-6b585069e6c9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:24.091953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ccb1c-cce8-497e-8666-6b585069e6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:24.092235 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ccb1c-cce8-497e-8666-6b585069e6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:24.118673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7f6ccb1c-cce8-497e-8666-6b585069e6c9 None None] MFA Rules not processed for user `e13f49bfa5554e05aed015de2882c22a`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:24.119841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7f6ccb1c-cce8-497e-8666-6b585069e6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:24.183881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1332/2649] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:24.188386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8e228-1343-44f9-8d8b-50722bf2cd19 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:24.248315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8e228-1343-44f9-8d8b-50722bf2cd19 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:24.252974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b48dd4-13b3-4ab8-ac0b-f53f2bef7bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:24.253619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b48dd4-13b3-4ab8-ac0b-f53f2bef7bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:24.253903 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b48dd4-13b3-4ab8-ac0b-f53f2bef7bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:24.254177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b48dd4-13b3-4ab8-ac0b-f53f2bef7bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:24.254867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b48dd4-13b3-4ab8-ac0b-f53f2bef7bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:24.256780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b48dd4-13b3-4ab8-ac0b-f53f2bef7bf8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:24.281508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1318/2650] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:24 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:24.285608 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ccb1c-cce8-497e-8666-6b585069e6c9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:24.297254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ccb1c-cce8-497e-8666-6b585069e6c9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:24.361731 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee0bdb-f122-4cdf-9933-cb89848c0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:24.362405 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee0bdb-f122-4cdf-9933-cb89848c0b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:24.362691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee0bdb-f122-4cdf-9933-cb89848c0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:24.362967 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee0bdb-f122-4cdf-9933-cb89848c0b3b admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:24.363686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee0bdb-f122-4cdf-9933-cb89848c0b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:24.365700 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee0bdb-f122-4cdf-9933-cb89848c0b3b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:24.388651 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1333/2651] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:24 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:24.390699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b48dd4-13b3-4ab8-ac0b-f53f2bef7bf8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:24.401096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b48dd4-13b3-4ab8-ac0b-f53f2bef7bf8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:24.406278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aec3e1-3ad5-4f39-afef-cd8dfe066558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:24.406933 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aec3e1-3ad5-4f39-afef-cd8dfe066558 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:24.407222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aec3e1-3ad5-4f39-afef-cd8dfe066558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:24.407996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aec3e1-3ad5-4f39-afef-cd8dfe066558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:24.408224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aec3e1-3ad5-4f39-afef-cd8dfe066558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:24.409864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aec3e1-3ad5-4f39-afef-cd8dfe066558 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:24.423399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1319/2652] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:24.427576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee0bdb-f122-4cdf-9933-cb89848c0b3b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:24.439157 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee0bdb-f122-4cdf-9933-cb89848c0b3b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:24.444425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616209c-4670-4613-b1e0-716d96585a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:24.444804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616209c-4670-4613-b1e0-716d96585a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:24.445089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616209c-4670-4613-b1e0-716d96585a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:24.445370 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616209c-4670-4613-b1e0-716d96585a3e admin admin] PATH_INFO: `/v3/projects/ef6b943bcbd64a87b906d1c26cecf4b2/users/41539e3efe1f411a8c94d7026da2ea00/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:24.462997 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616209c-4670-4613-b1e0-716d96585a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6b943bcbd64a87b906d1c26cecf4b2, user_id=41539e3efe1f411a8c94d7026da2ea00, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:24.467101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616209c-4670-4613-b1e0-716d96585a3e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:24.482912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1334/2653] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:24 2022] PUT /identity/v3/projects/ef6b943bcbd64a87b906d1c26cecf4b2/users/41539e3efe1f411a8c94d7026da2ea00/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:24.487328 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aec3e1-3ad5-4f39-afef-cd8dfe066558 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:24.505584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aec3e1-3ad5-4f39-afef-cd8dfe066558 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:24.550362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:24.562445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679eb65-3801-4c06-bfb9-8e772e15418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:24.563146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679eb65-3801-4c06-bfb9-8e772e15418a admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:24.563431 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679eb65-3801-4c06-bfb9-8e772e15418a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:24.563766 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679eb65-3801-4c06-bfb9-8e772e15418a admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:24.564495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679eb65-3801-4c06-bfb9-8e772e15418a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:24.566150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679eb65-3801-4c06-bfb9-8e772e15418a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:24.576853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1320/2654] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:24.581017 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616209c-4670-4613-b1e0-716d96585a3e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:24.592053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616209c-4670-4613-b1e0-716d96585a3e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:24.596735 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf16d4f-75ce-403a-9652-f60e65056e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:24.597643 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf16d4f-75ce-403a-9652-f60e65056e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:24.597932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf16d4f-75ce-403a-9652-f60e65056e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:24.598214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf16d4f-75ce-403a-9652-f60e65056e32 admin admin] PATH_INFO: `/v3/projects/ef6b943bcbd64a87b906d1c26cecf4b2/users/41539e3efe1f411a8c94d7026da2ea00/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:24.600184 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf16d4f-75ce-403a-9652-f60e65056e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6b943bcbd64a87b906d1c26cecf4b2, user_id=41539e3efe1f411a8c94d7026da2ea00, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:24.602859 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf16d4f-75ce-403a-9652-f60e65056e32 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:24.613220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1335/2655] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:24 2022] PUT /identity/v3/projects/ef6b943bcbd64a87b906d1c26cecf4b2/users/41539e3efe1f411a8c94d7026da2ea00/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:24.624734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0637a4-ee71-41d3-876e-e40a0beca3a4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:24.625031 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0637a4-ee71-41d3-876e-e40a0beca3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:24.625320 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0637a4-ee71-41d3-876e-e40a0beca3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:24.651526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1e0637a4-ee71-41d3-876e-e40a0beca3a4 None None] MFA Rules not processed for user `41539e3efe1f411a8c94d7026da2ea00`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:24.652790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1e0637a4-ee71-41d3-876e-e40a0beca3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:24.725234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1321/2656] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:24.735938 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf16d4f-75ce-403a-9652-f60e65056e32 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:24.737797 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-abf16d4f-75ce-403a-9652-f60e65056e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:24.760031 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:24.799723 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf16d4f-75ce-403a-9652-f60e65056e32 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:24.803720 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c2391-7d68-488c-b1e2-e8093e9661f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:24.804372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c2391-7d68-488c-b1e2-e8093e9661f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:24.804811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c2391-7d68-488c-b1e2-e8093e9661f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:24.805107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c2391-7d68-488c-b1e2-e8093e9661f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:24.814871 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c2391-7d68-488c-b1e2-e8093e9661f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:24.816334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c2391-7d68-488c-b1e2-e8093e9661f3 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:24.826598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1336/2657] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:24.957200 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0637a4-ee71-41d3-876e-e40a0beca3a4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:25.022725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0637a4-ee71-41d3-876e-e40a0beca3a4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:25.027233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:25.028145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:25.028385 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:25.028693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] PATH_INFO: `/v3/users/e13f49bfa5554e05aed015de2882c22a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:25.029911 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13f49bfa5554e05aed015de2882c22a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:25.031871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:25.082353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13f49bfa5554e05aed015de2882c22a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:25.090127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13f49bfa5554e05aed015de2882c22a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:25.090792 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13f49bfa5554e05aed015de2882c22a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:25.091393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13f49bfa5554e05aed015de2882c22a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:25.103432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13f49bfa5554e05aed015de2882c22a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:25.105486 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:25.118065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1322/2658] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:24 2022] DELETE /identity/v3/users/e13f49bfa5554e05aed015de2882c22a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:25.123163 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be48ab4-befb-48e6-9932-4a3afe4185b9 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:25.123619 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be48ab4-befb-48e6-9932-4a3afe4185b9 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:25.123906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be48ab4-befb-48e6-9932-4a3afe4185b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:25.141539 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-1be48ab4-befb-48e6-9932-4a3afe4185b9 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:25.142750 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1be48ab4-befb-48e6-9932-4a3afe4185b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:25.205027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1337/2659] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:25.215055 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:25.216881 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:25.284388 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39effa-69e3-4fa4-b607-771e3ecd0cab admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:25.288142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb7f0-ca13-4dbc-965b-5d5fe261707b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:25.288826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb7f0-ca13-4dbc-965b-5d5fe261707b service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:25.289192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb7f0-ca13-4dbc-965b-5d5fe261707b service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:25.289396 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb7f0-ca13-4dbc-965b-5d5fe261707b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:25.299754 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83eb7f0-ca13-4dbc-965b-5d5fe261707b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:25.301242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83eb7f0-ca13-4dbc-965b-5d5fe261707b service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:25.312054 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1323/2660] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:25.718012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be48ab4-befb-48e6-9932-4a3afe4185b9 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:25.720114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1be48ab4-befb-48e6-9932-4a3afe4185b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:25.743791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be48ab4-befb-48e6-9932-4a3afe4185b9 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:25.750909 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:25.751958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:25.752255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:25.752535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] PATH_INFO: `/v3/projects/7e2ff4217f0946b4ac8a6c4386e3984c` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:25.754016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2ff4217f0946b4ac8a6c4386e3984c)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:25.757002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:25.819228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2ff4217f0946b4ac8a6c4386e3984c', 'request_id': 'req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:25.826078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2ff4217f0946b4ac8a6c4386e3984c', 'request_id': 'req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:25.833816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2ff4217f0946b4ac8a6c4386e3984c', 'request_id': 'req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:25.845002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] The token cache is being invalidate because project 7e2ff4217f0946b4ac8a6c4386e3984c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:25.845368 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:25.846095 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:25.847741 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1338/2661] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:25 2022] DELETE /identity/v3/projects/7e2ff4217f0946b4ac8a6c4386e3984c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:25.851862 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb7f0-ca13-4dbc-965b-5d5fe261707b service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:25.872528 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb7f0-ca13-4dbc-965b-5d5fe261707b service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:25.930612 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1071145-2317-44fa-85fb-1790ec383548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:25.931397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1071145-2317-44fa-85fb-1790ec383548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:25.931683 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1071145-2317-44fa-85fb-1790ec383548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:25.931959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1071145-2317-44fa-85fb-1790ec383548 admin admin] PATH_INFO: `/v3/users/41539e3efe1f411a8c94d7026da2ea00` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:25.934917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1071145-2317-44fa-85fb-1790ec383548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41539e3efe1f411a8c94d7026da2ea00)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:25.935817 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1071145-2317-44fa-85fb-1790ec383548 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:25.989761 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f1071145-2317-44fa-85fb-1790ec383548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41539e3efe1f411a8c94d7026da2ea00'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:25.999515 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f1071145-2317-44fa-85fb-1790ec383548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41539e3efe1f411a8c94d7026da2ea00'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.000386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f1071145-2317-44fa-85fb-1790ec383548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41539e3efe1f411a8c94d7026da2ea00'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.001087 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f1071145-2317-44fa-85fb-1790ec383548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41539e3efe1f411a8c94d7026da2ea00'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.019211 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f1071145-2317-44fa-85fb-1790ec383548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41539e3efe1f411a8c94d7026da2ea00'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.034283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1324/2662] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:25 2022] DELETE /identity/v3/users/41539e3efe1f411a8c94d7026da2ea00 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:26.318653 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:26.320317 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:26.336451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b5d7-74fa-40d3-8d75-a3de1bd4a2ee admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:26.384763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:26.401699 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:26.402562 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.402877 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.403186 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] PATH_INFO: `/v3/projects/ef6b943bcbd64a87b906d1c26cecf4b2` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.404508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6b943bcbd64a87b906d1c26cecf4b2)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:26.406535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:26.458274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6b943bcbd64a87b906d1c26cecf4b2', 'request_id': 'req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.464479 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6b943bcbd64a87b906d1c26cecf4b2', 'request_id': 'req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.472919 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6b943bcbd64a87b906d1c26cecf4b2', 'request_id': 'req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.484742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] The token cache is being invalidate because project ef6b943bcbd64a87b906d1c26cecf4b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:26.485065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.485710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-b338c18d-bb02-40f0-b7df-fe2ad8b1ea00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:26.487260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1339/2663] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:26 2022] DELETE /identity/v3/projects/ef6b943bcbd64a87b906d1c26cecf4b2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:26.492130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41b53b-a00d-47d4-ad75-f858177c4c0d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.492535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41b53b-a00d-47d4-ad75-f858177c4c0d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.492964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41b53b-a00d-47d4-ad75-f858177c4c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.511387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-fa41b53b-a00d-47d4-ad75-f858177c4c0d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:26.513260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fa41b53b-a00d-47d4-ad75-f858177c4c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:26.522152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:26.580801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1325/2664] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:26.588305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f290d-ae0c-4dc4-a0af-ff5f0bd186ba None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.588594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f290d-ae0c-4dc4-a0af-ff5f0bd186ba None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.588931 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f290d-ae0c-4dc4-a0af-ff5f0bd186ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.606881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3e0f290d-ae0c-4dc4-a0af-ff5f0bd186ba None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:26.608065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3e0f290d-ae0c-4dc4-a0af-ff5f0bd186ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:26.615976 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1340/2665] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:26.620108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41b53b-a00d-47d4-ad75-f858177c4c0d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:26.630445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41b53b-a00d-47d4-ad75-f858177c4c0d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:26.635012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af409852-e8f2-4c88-a24c-a13aeb472052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:26.635662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af409852-e8f2-4c88-a24c-a13aeb472052 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.635944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af409852-e8f2-4c88-a24c-a13aeb472052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.636219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af409852-e8f2-4c88-a24c-a13aeb472052 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.636974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af409852-e8f2-4c88-a24c-a13aeb472052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:26.637996 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af409852-e8f2-4c88-a24c-a13aeb472052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:26.639553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af409852-e8f2-4c88-a24c-a13aeb472052 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:26.651107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1326/2666] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:26.655586 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f290d-ae0c-4dc4-a0af-ff5f0bd186ba None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:26.664891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f290d-ae0c-4dc4-a0af-ff5f0bd186ba None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:26.670503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50135c-294a-422c-a53c-75f3f2e4e645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:26.671149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50135c-294a-422c-a53c-75f3f2e4e645 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.671430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50135c-294a-422c-a53c-75f3f2e4e645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.671704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50135c-294a-422c-a53c-75f3f2e4e645 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.672394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50135c-294a-422c-a53c-75f3f2e4e645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:26.674344 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50135c-294a-422c-a53c-75f3f2e4e645 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:26.701623 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1341/2667] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:26 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:26.705960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af409852-e8f2-4c88-a24c-a13aeb472052 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:26.718046 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af409852-e8f2-4c88-a24c-a13aeb472052 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:26.779395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377f804-f8f0-41ed-928e-b0fc64db3b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:26.780170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377f804-f8f0-41ed-928e-b0fc64db3b1e admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.780462 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377f804-f8f0-41ed-928e-b0fc64db3b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.780792 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377f804-f8f0-41ed-928e-b0fc64db3b1e admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.781507 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377f804-f8f0-41ed-928e-b0fc64db3b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:26.783439 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377f804-f8f0-41ed-928e-b0fc64db3b1e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:26.807190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1327/2668] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:26 2022] POST /identity/v3/users => generated 305 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:26.808485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50135c-294a-422c-a53c-75f3f2e4e645 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:26.824267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50135c-294a-422c-a53c-75f3f2e4e645 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:26.830149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590ff5c-067b-419b-9037-31eb8b2b9b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:26.830832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590ff5c-067b-419b-9037-31eb8b2b9b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.831113 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590ff5c-067b-419b-9037-31eb8b2b9b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.831396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590ff5c-067b-419b-9037-31eb8b2b9b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.832124 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590ff5c-067b-419b-9037-31eb8b2b9b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:26.834061 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590ff5c-067b-419b-9037-31eb8b2b9b6c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:26.848261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1342/2669] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:26.849586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377f804-f8f0-41ed-928e-b0fc64db3b1e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:26.860823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377f804-f8f0-41ed-928e-b0fc64db3b1e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:26.865987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82840bbb-2082-4ceb-9c0b-f8381e21fbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:26.866693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840bbb-2082-4ceb-9c0b-f8381e21fbdb admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.866983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840bbb-2082-4ceb-9c0b-f8381e21fbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.867300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840bbb-2082-4ceb-9c0b-f8381e21fbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.868184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82840bbb-2082-4ceb-9c0b-f8381e21fbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:26.869899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82840bbb-2082-4ceb-9c0b-f8381e21fbdb admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:26.882387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1328/2670] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:26.886514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590ff5c-067b-419b-9037-31eb8b2b9b6c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:26.897510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590ff5c-067b-419b-9037-31eb8b2b9b6c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:26.902948 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04733d51-05fe-47c2-98c6-bf83fdbf6c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:26.904595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04733d51-05fe-47c2-98c6-bf83fdbf6c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.905453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04733d51-05fe-47c2-98c6-bf83fdbf6c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.905453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04733d51-05fe-47c2-98c6-bf83fdbf6c30 admin admin] PATH_INFO: `/v3/projects/24b4fb7002004d77a70c44d8ed2264c0/users/2097daa813b14255bfa8064fa9604dfd/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.927383 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04733d51-05fe-47c2-98c6-bf83fdbf6c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b4fb7002004d77a70c44d8ed2264c0, user_id=2097daa813b14255bfa8064fa9604dfd, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:26.930233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04733d51-05fe-47c2-98c6-bf83fdbf6c30 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:26.950693 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1343/2671] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:26 2022] PUT /identity/v3/projects/24b4fb7002004d77a70c44d8ed2264c0/users/2097daa813b14255bfa8064fa9604dfd/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:26.958383 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf17633-f4fb-4c94-95ee-a4ff25a16e02 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:26.959144 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf17633-f4fb-4c94-95ee-a4ff25a16e02 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:26.959658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf17633-f4fb-4c94-95ee-a4ff25a16e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:26.992438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-baf17633-f4fb-4c94-95ee-a4ff25a16e02 None None] MFA Rules not processed for user `2097daa813b14255bfa8064fa9604dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:26.994072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-baf17633-f4fb-4c94-95ee-a4ff25a16e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:27.075576 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1329/2672] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:27.080100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04733d51-05fe-47c2-98c6-bf83fdbf6c30 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:27.145410 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04733d51-05fe-47c2-98c6-bf83fdbf6c30 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.150353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d15611-6eab-4fb4-bb5e-c64c604efd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.151056 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d15611-6eab-4fb4-bb5e-c64c604efd92 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.151347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d15611-6eab-4fb4-bb5e-c64c604efd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.151630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d15611-6eab-4fb4-bb5e-c64c604efd92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.152338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d15611-6eab-4fb4-bb5e-c64c604efd92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.154894 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d15611-6eab-4fb4-bb5e-c64c604efd92 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:27.175059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:27.183460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1344/2673] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:27 2022] POST /identity/v3/projects => generated 409 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:27.187600 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf17633-f4fb-4c94-95ee-a4ff25a16e02 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:27.198290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf17633-f4fb-4c94-95ee-a4ff25a16e02 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.202866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:27.257026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee2e1e-97a2-4f1a-865b-bc5a5a079442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.257861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee2e1e-97a2-4f1a-865b-bc5a5a079442 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.258152 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee2e1e-97a2-4f1a-865b-bc5a5a079442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.258454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee2e1e-97a2-4f1a-865b-bc5a5a079442 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.259146 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee2e1e-97a2-4f1a-865b-bc5a5a079442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.261121 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee2e1e-97a2-4f1a-865b-bc5a5a079442 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:27.285591 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1330/2674] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:27 2022] POST /identity/v3/users => generated 311 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:27.286614 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d15611-6eab-4fb4-bb5e-c64c604efd92 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:27.298142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d15611-6eab-4fb4-bb5e-c64c604efd92 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.302927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563b56f-7452-481d-a8e5-c7f9d6e3342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.303583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b56f-7452-481d-a8e5-c7f9d6e3342c admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.303875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b56f-7452-481d-a8e5-c7f9d6e3342c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.304159 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b56f-7452-481d-a8e5-c7f9d6e3342c admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.304941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563b56f-7452-481d-a8e5-c7f9d6e3342c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.306897 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563b56f-7452-481d-a8e5-c7f9d6e3342c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:27.319904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1345/2675] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:27.323694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee2e1e-97a2-4f1a-865b-bc5a5a079442 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:27.334398 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee2e1e-97a2-4f1a-865b-bc5a5a079442 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.339128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fead319-f04e-4df5-ac0d-54f1cb0701ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.340011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead319-f04e-4df5-ac0d-54f1cb0701ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.340847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead319-f04e-4df5-ac0d-54f1cb0701ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.341147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead319-f04e-4df5-ac0d-54f1cb0701ba admin admin] PATH_INFO: `/v3/projects/9efcddf4e87e44b786e8461840cec6d4/users/c08f95ee4101477d9e70aac58b864af5/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.356897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fead319-f04e-4df5-ac0d-54f1cb0701ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efcddf4e87e44b786e8461840cec6d4, user_id=c08f95ee4101477d9e70aac58b864af5, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.359635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fead319-f04e-4df5-ac0d-54f1cb0701ba admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:27.374027 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1331/2676] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:27 2022] PUT /identity/v3/projects/9efcddf4e87e44b786e8461840cec6d4/users/c08f95ee4101477d9e70aac58b864af5/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:27.378158 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563b56f-7452-481d-a8e5-c7f9d6e3342c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:27.389322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563b56f-7452-481d-a8e5-c7f9d6e3342c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.451072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b41293-22d4-4e01-bb01-a7de43a470b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.451729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41293-22d4-4e01-bb01-a7de43a470b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.452019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41293-22d4-4e01-bb01-a7de43a470b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.452302 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41293-22d4-4e01-bb01-a7de43a470b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.453128 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b41293-22d4-4e01-bb01-a7de43a470b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.454694 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b41293-22d4-4e01-bb01-a7de43a470b9 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:27.466055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1346/2677] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:27.471488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fead319-f04e-4df5-ac0d-54f1cb0701ba admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:27.484589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fead319-f04e-4df5-ac0d-54f1cb0701ba admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.489552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc171144-8034-4ada-8d86-96827082c29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.490367 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171144-8034-4ada-8d86-96827082c29e admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.492724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171144-8034-4ada-8d86-96827082c29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.492724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171144-8034-4ada-8d86-96827082c29e admin admin] PATH_INFO: `/v3/projects/9efcddf4e87e44b786e8461840cec6d4/users/c08f95ee4101477d9e70aac58b864af5/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.493217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc171144-8034-4ada-8d86-96827082c29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efcddf4e87e44b786e8461840cec6d4, user_id=c08f95ee4101477d9e70aac58b864af5, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.496032 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc171144-8034-4ada-8d86-96827082c29e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:27.507368 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1332/2678] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:27 2022] PUT /identity/v3/projects/9efcddf4e87e44b786e8461840cec6d4/users/c08f95ee4101477d9e70aac58b864af5/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:27.518485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7a88-cdc7-42cb-aa49-2fd38641cc00 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.518785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7a88-cdc7-42cb-aa49-2fd38641cc00 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.519068 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7a88-cdc7-42cb-aa49-2fd38641cc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.545927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-569c7a88-cdc7-42cb-aa49-2fd38641cc00 None None] MFA Rules not processed for user `c08f95ee4101477d9e70aac58b864af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:27.547160 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-569c7a88-cdc7-42cb-aa49-2fd38641cc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:27.616792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1347/2679] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:27.628954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc171144-8034-4ada-8d86-96827082c29e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:27.630925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-dc171144-8034-4ada-8d86-96827082c29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:27.692946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc171144-8034-4ada-8d86-96827082c29e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.696861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9f12d-d0b2-427c-8ac2-a174341efd68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.697527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9f12d-d0b2-427c-8ac2-a174341efd68 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.697892 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9f12d-d0b2-427c-8ac2-a174341efd68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.698165 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9f12d-d0b2-427c-8ac2-a174341efd68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.708190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9f12d-d0b2-427c-8ac2-a174341efd68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.709574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9f12d-d0b2-427c-8ac2-a174341efd68 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:27.719411 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1333/2680] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:27.864787 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c7a88-cdc7-42cb-aa49-2fd38641cc00 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:27.874495 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c7a88-cdc7-42cb-aa49-2fd38641cc00 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:27.878080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b54eb1-102e-4526-ad26-33573568c982 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:27.878721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b54eb1-102e-4526-ad26-33573568c982 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:27.879018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b54eb1-102e-4526-ad26-33573568c982 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:27.879293 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b54eb1-102e-4526-ad26-33573568c982 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:27.935540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b54eb1-102e-4526-ad26-33573568c982 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:27.937017 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b54eb1-102e-4526-ad26-33573568c982 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:27.945929 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1348/2681] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:27 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:29.803213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9f12d-d0b2-427c-8ac2-a174341efd68 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:29.804734 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5cd9f12d-d0b2-427c-8ac2-a174341efd68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:29.862281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9f12d-d0b2-427c-8ac2-a174341efd68 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:29.866056 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0e2f-a31a-4369-af24-4f2faf3df75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:29.866751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0e2f-a31a-4369-af24-4f2faf3df75a service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:29.867040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0e2f-a31a-4369-af24-4f2faf3df75a service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:29.867323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0e2f-a31a-4369-af24-4f2faf3df75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:29.869202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b6df0e2f-a31a-4369-af24-4f2faf3df75a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:29.887063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:29.932753 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df0e2f-a31a-4369-af24-4f2faf3df75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:29.934186 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df0e2f-a31a-4369-af24-4f2faf3df75a service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:29.944819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1334/2682] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:30.188683 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b54eb1-102e-4526-ad26-33573568c982 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:30.190213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-02b54eb1-102e-4526-ad26-33573568c982 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:30.202441 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b54eb1-102e-4526-ad26-33573568c982 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:30.206060 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ceb1d-e66b-4015-baf2-f776ffc1819d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:30.206703 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ceb1d-e66b-4015-baf2-f776ffc1819d service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:30.206991 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ceb1d-e66b-4015-baf2-f776ffc1819d service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:30.207274 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ceb1d-e66b-4015-baf2-f776ffc1819d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:30.209174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-706ceb1d-e66b-4015-baf2-f776ffc1819d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:30.214222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:30.271480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ceb1d-e66b-4015-baf2-f776ffc1819d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:30.272722 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ceb1d-e66b-4015-baf2-f776ffc1819d service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:30.282735 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1349/2683] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:33.461535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0e2f-a31a-4369-af24-4f2faf3df75a service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:33.477083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0e2f-a31a-4369-af24-4f2faf3df75a service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:33.484800 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:33.486166 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:33.486583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:33.487494 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] PATH_INFO: `/v3/users/2097daa813b14255bfa8064fa9604dfd` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:33.488809 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2097daa813b14255bfa8064fa9604dfd)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:33.491957 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:33.518767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ceb1d-e66b-4015-baf2-f776ffc1819d service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:33.522519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-706ceb1d-e66b-4015-baf2-f776ffc1819d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:33.562179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2097daa813b14255bfa8064fa9604dfd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:33.576074 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2097daa813b14255bfa8064fa9604dfd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:33.579654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2097daa813b14255bfa8064fa9604dfd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:33.580672 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2097daa813b14255bfa8064fa9604dfd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:33.600288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2097daa813b14255bfa8064fa9604dfd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:33.623621 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1335/2684] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:33 2022] DELETE /identity/v3/users/2097daa813b14255bfa8064fa9604dfd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:33.627386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:33.629615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:33.634712 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ceb1d-e66b-4015-baf2-f776ffc1819d service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:33.699752 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2ddbf-a239-4097-9627-caf1d6c5960a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:33.703520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc23b0-7171-4c68-823b-af87bebdfeb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:33.704252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc23b0-7171-4c68-823b-af87bebdfeb5 service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:33.704654 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc23b0-7171-4c68-823b-af87bebdfeb5 service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:33.705580 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc23b0-7171-4c68-823b-af87bebdfeb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:33.706355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:33.707024 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0dfc23b0-7171-4c68-823b-af87bebdfeb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:33.707741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:33.707741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:33.707945 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] PATH_INFO: `/v3/users/c9ea06c7648041d88aff6e58afcb8219` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:33.709089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ea06c7648041d88aff6e58afcb8219)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:33.711014 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:33.721436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc23b0-7171-4c68-823b-af87bebdfeb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:33.723477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc23b0-7171-4c68-823b-af87bebdfeb5 service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:33.735837 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1350/2685] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:22:33.737183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4789-629b-4bdf-a6df-093c3a26d252 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:33.737473 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4789-629b-4bdf-a6df-093c3a26d252 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:33.737775 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4789-629b-4bdf-a6df-093c3a26d252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:33.751646 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:33.759303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ebcf4789-629b-4bdf-a6df-093c3a26d252 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:33.760601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ebcf4789-629b-4bdf-a6df-093c3a26d252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:33.770815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1351/2686] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:33.782420 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf4789-629b-4bdf-a6df-093c3a26d252 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:33.783127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ea06c7648041d88aff6e58afcb8219'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:33.783811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ebcf4789-629b-4bdf-a6df-093c3a26d252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:33.793230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ea06c7648041d88aff6e58afcb8219'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:33.794145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ea06c7648041d88aff6e58afcb8219'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:33.795155 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ea06c7648041d88aff6e58afcb8219'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:33.812555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ea06c7648041d88aff6e58afcb8219'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:33.820378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:33.835970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1336/2687] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:33 2022] DELETE /identity/v3/users/c9ea06c7648041d88aff6e58afcb8219 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:33.851004 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf4789-629b-4bdf-a6df-093c3a26d252 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:33.902521 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b039664-1fdd-4614-8635-4c921179821e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:33.903175 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b039664-1fdd-4614-8635-4c921179821e service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:33.903462 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b039664-1fdd-4614-8635-4c921179821e service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:33.903751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b039664-1fdd-4614-8635-4c921179821e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:33.905636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8b039664-1fdd-4614-8635-4c921179821e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:33.978833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b039664-1fdd-4614-8635-4c921179821e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:33.980308 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b039664-1fdd-4614-8635-4c921179821e service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:33.998792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1352/2688] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:22:34.141658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:34.143041 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:34.167702 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78e26a-c2ff-4cc8-af06-fe5a8bc51eb4 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:34.177378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:34.178259 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:34.178618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:34.178883 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] PATH_INFO: `/v3/projects/0c67b7c1a98845cb81d84328e6e084e3` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:34.180277 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c67b7c1a98845cb81d84328e6e084e3)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:34.182352 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:34.239231 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c67b7c1a98845cb81d84328e6e084e3', 'request_id': 'req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.246848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c67b7c1a98845cb81d84328e6e084e3', 'request_id': 'req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.259890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c67b7c1a98845cb81d84328e6e084e3', 'request_id': 'req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.276708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] The token cache is being invalidate because project 0c67b7c1a98845cb81d84328e6e084e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:34.277096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.277866 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.280520 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1337/2689] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:34 2022] DELETE /identity/v3/projects/0c67b7c1a98845cb81d84328e6e084e3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:34.285830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2c111-3a34-450f-98e5-424c1bcc7a4f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:34.286396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2c111-3a34-450f-98e5-424c1bcc7a4f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:34.286900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2c111-3a34-450f-98e5-424c1bcc7a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:34.313799 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-8cb2c111-3a34-450f-98e5-424c1bcc7a4f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:34.315477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8cb2c111-3a34-450f-98e5-424c1bcc7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:34.326022 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:34.327704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:34.414400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933fc6c-9f6d-41b9-91d0-1e846c40eb1a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:34.419553 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:34.420444 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:34.421291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:34.421633 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] PATH_INFO: `/v3/projects/24b4fb7002004d77a70c44d8ed2264c0` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:34.422987 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b4fb7002004d77a70c44d8ed2264c0)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:34.425023 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:34.479763 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:34.506549 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b4fb7002004d77a70c44d8ed2264c0', 'request_id': 'req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.510341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1353/2690] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:34.512054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81695629-37f5-49ac-9fc5-31d73f87038e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:34.512505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81695629-37f5-49ac-9fc5-31d73f87038e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:34.513107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81695629-37f5-49ac-9fc5-31d73f87038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:34.514535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b4fb7002004d77a70c44d8ed2264c0', 'request_id': 'req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.522740 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b4fb7002004d77a70c44d8ed2264c0', 'request_id': 'req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.536603 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-81695629-37f5-49ac-9fc5-31d73f87038e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:34.537901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-81695629-37f5-49ac-9fc5-31d73f87038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:34.550618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] The token cache is being invalidate because project 24b4fb7002004d77a70c44d8ed2264c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:34.551097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.552002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.554213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1338/2691] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:34 2022] DELETE /identity/v3/projects/24b4fb7002004d77a70c44d8ed2264c0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:34.560757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:34.573780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:34.587059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:34.632359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1354/2692] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:34.636641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81695629-37f5-49ac-9fc5-31d73f87038e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:34.646221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81695629-37f5-49ac-9fc5-31d73f87038e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:34.650986 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe38f1-d2d4-42ff-b377-f8fa7ef8e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:34.651792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe38f1-d2d4-42ff-b377-f8fa7ef8e7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:34.652075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe38f1-d2d4-42ff-b377-f8fa7ef8e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:34.652356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe38f1-d2d4-42ff-b377-f8fa7ef8e7c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:34.653124 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe38f1-d2d4-42ff-b377-f8fa7ef8e7c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:34.653434 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe38f1-d2d4-42ff-b377-f8fa7ef8e7c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:34.655067 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe38f1-d2d4-42ff-b377-f8fa7ef8e7c1 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:34.656482 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461a5e8-84ef-46aa-9447-e2ce78a2ef1f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:34.661889 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:34.662778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:34.663059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:34.663336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] PATH_INFO: `/v3/users/c08f95ee4101477d9e70aac58b864af5` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:34.664551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08f95ee4101477d9e70aac58b864af5)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:34.666980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:34.668658 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1355/2693] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:22:34.673431 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe38f1-d2d4-42ff-b377-f8fa7ef8e7c1 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:34.684328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe38f1-d2d4-42ff-b377-f8fa7ef8e7c1 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:34.690009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22256f0b-9e09-424a-894a-afde2012d08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:34.690665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22256f0b-9e09-424a-894a-afde2012d08a admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:34.690953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22256f0b-9e09-424a-894a-afde2012d08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:34.691236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22256f0b-9e09-424a-894a-afde2012d08a admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:34.691928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22256f0b-9e09-424a-894a-afde2012d08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:34.693913 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22256f0b-9e09-424a-894a-afde2012d08a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:34.719283 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08f95ee4101477d9e70aac58b864af5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.726321 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1356/2694] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:34 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:34.727555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22256f0b-9e09-424a-894a-afde2012d08a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:34.727730 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08f95ee4101477d9e70aac58b864af5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.728356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08f95ee4101477d9e70aac58b864af5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.729145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08f95ee4101477d9e70aac58b864af5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.741975 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08f95ee4101477d9e70aac58b864af5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:34.754628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1339/2695] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:34 2022] DELETE /identity/v3/users/c08f95ee4101477d9e70aac58b864af5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:34.796513 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22256f0b-9e09-424a-894a-afde2012d08a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:34.881271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead2551-0f18-4f55-af19-76b7f51c8123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:34.881963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2551-0f18-4f55-af19-76b7f51c8123 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:34.882255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2551-0f18-4f55-af19-76b7f51c8123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:34.882539 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2551-0f18-4f55-af19-76b7f51c8123 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:34.883240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead2551-0f18-4f55-af19-76b7f51c8123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:34.885222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead2551-0f18-4f55-af19-76b7f51c8123 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:34.908590 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1357/2696] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:34 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:34.913288 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:34.914942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:34.929179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e5a49-d88d-427e-83d0-127ee74bdc0d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:34.934703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0b862-62bd-40b8-97c7-2efc5f298338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:34.935384 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0b862-62bd-40b8-97c7-2efc5f298338 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:34.935678 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0b862-62bd-40b8-97c7-2efc5f298338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:34.935959 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0b862-62bd-40b8-97c7-2efc5f298338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:34.936777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0b862-62bd-40b8-97c7-2efc5f298338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:34.938409 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0b862-62bd-40b8-97c7-2efc5f298338 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:34.953603 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1340/2697] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:34.957674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead2551-0f18-4f55-af19-76b7f51c8123 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:34.969526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead2551-0f18-4f55-af19-76b7f51c8123 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:34.974960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc5bb-7386-4651-ac43-d7fe275a0cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:34.975853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc5bb-7386-4651-ac43-d7fe275a0cee admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:34.976138 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc5bb-7386-4651-ac43-d7fe275a0cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:34.976440 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc5bb-7386-4651-ac43-d7fe275a0cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:34.977224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dc5bb-7386-4651-ac43-d7fe275a0cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:34.978840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dc5bb-7386-4651-ac43-d7fe275a0cee admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:34.989480 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1358/2698] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:34.993805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0b862-62bd-40b8-97c7-2efc5f298338 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:35.004707 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0b862-62bd-40b8-97c7-2efc5f298338 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:35.009583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4219f-9ea7-49dd-aaff-235318de95e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:35.010563 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4219f-9ea7-49dd-aaff-235318de95e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.010923 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4219f-9ea7-49dd-aaff-235318de95e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.011278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4219f-9ea7-49dd-aaff-235318de95e3 admin admin] PATH_INFO: `/v3/projects/596a2cdd1323457c9a53fc7a4384262e/users/5e2fa25be8de4b88aaad78ce0001791e/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.027316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4219f-9ea7-49dd-aaff-235318de95e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596a2cdd1323457c9a53fc7a4384262e, user_id=5e2fa25be8de4b88aaad78ce0001791e, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:35.031002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4219f-9ea7-49dd-aaff-235318de95e3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:35.044571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1341/2699] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:34 2022] PUT /identity/v3/projects/596a2cdd1323457c9a53fc7a4384262e/users/5e2fa25be8de4b88aaad78ce0001791e/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:35.050012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87b87a-9039-4125-a580-5c8bad99fd7f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.050307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87b87a-9039-4125-a580-5c8bad99fd7f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.050585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87b87a-9039-4125-a580-5c8bad99fd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.059190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4219f-9ea7-49dd-aaff-235318de95e3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:35.060939 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5cc4219f-9ea7-49dd-aaff-235318de95e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:35.066366 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:35.070546 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-5b87b87a-9039-4125-a580-5c8bad99fd7f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:35.071761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5b87b87a-9039-4125-a580-5c8bad99fd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:35.101899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:35.141111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1359/2700] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:35.145587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4219f-9ea7-49dd-aaff-235318de95e3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:35.151380 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87b87a-9039-4125-a580-5c8bad99fd7f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:35.151810 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:35.152817 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5b87b87a-9039-4125-a580-5c8bad99fd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:35.152948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.153145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.153421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] PATH_INFO: `/v3/projects/9efcddf4e87e44b786e8461840cec6d4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.154630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efcddf4e87e44b786e8461840cec6d4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:35.157156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:35.208632 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efcddf4e87e44b786e8461840cec6d4', 'request_id': 'req-9888656c-81b4-4b3a-ac84-300e7a7f6577'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:35.214185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87b87a-9039-4125-a580-5c8bad99fd7f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:35.214952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efcddf4e87e44b786e8461840cec6d4', 'request_id': 'req-9888656c-81b4-4b3a-ac84-300e7a7f6577'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:35.221547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efcddf4e87e44b786e8461840cec6d4', 'request_id': 'req-9888656c-81b4-4b3a-ac84-300e7a7f6577'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:35.234323 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] The token cache is being invalidate because project 9efcddf4e87e44b786e8461840cec6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:35.234615 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:35.235262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9888656c-81b4-4b3a-ac84-300e7a7f6577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:35.236923 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1342/2701] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:35 2022] DELETE /identity/v3/projects/9efcddf4e87e44b786e8461840cec6d4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:35.241582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddeafd-b0d8-44bc-ad25-00d9d8b532ca None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.241880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddeafd-b0d8-44bc-ad25-00d9d8b532ca None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.242161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddeafd-b0d8-44bc-ad25-00d9d8b532ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.260692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a5ddeafd-b0d8-44bc-ad25-00d9d8b532ca None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:35.261811 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a5ddeafd-b0d8-44bc-ad25-00d9d8b532ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:35.266946 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4ce8-6073-48b1-9fa2-eb8aacff8a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:35.267638 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4ce8-6073-48b1-9fa2-eb8aacff8a38 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.267952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4ce8-6073-48b1-9fa2-eb8aacff8a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.268230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4ce8-6073-48b1-9fa2-eb8aacff8a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.270103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-056a4ce8-6073-48b1-9fa2-eb8aacff8a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:35.323257 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1343/2702] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:35.331828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55143e-bdc6-4a0a-b331-17a0f767dd4d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.332118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55143e-bdc6-4a0a-b331-17a0f767dd4d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.332431 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55143e-bdc6-4a0a-b331-17a0f767dd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.339303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4ce8-6073-48b1-9fa2-eb8aacff8a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:35.340955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4ce8-6073-48b1-9fa2-eb8aacff8a38 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:35.350485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5d55143e-bdc6-4a0a-b331-17a0f767dd4d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:35.351594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1360/2703] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:22:35.351773 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5d55143e-bdc6-4a0a-b331-17a0f767dd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:35.359762 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1344/2704] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:35.363881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4ce8-6073-48b1-9fa2-eb8aacff8a38 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:35.373374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4ce8-6073-48b1-9fa2-eb8aacff8a38 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:35.379861 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64c98-5c72-4856-8018-4e39926ea958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:35.380374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64c98-5c72-4856-8018-4e39926ea958 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.380696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64c98-5c72-4856-8018-4e39926ea958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.380980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64c98-5c72-4856-8018-4e39926ea958 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.381720 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd64c98-5c72-4856-8018-4e39926ea958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:35.382033 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd64c98-5c72-4856-8018-4e39926ea958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:35.383674 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd64c98-5c72-4856-8018-4e39926ea958 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:35.400122 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1361/2705] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:35.401557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55143e-bdc6-4a0a-b331-17a0f767dd4d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:35.411556 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55143e-bdc6-4a0a-b331-17a0f767dd4d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:35.416460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324d284-e56f-40b9-a911-f2630e8f4890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:35.417164 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324d284-e56f-40b9-a911-f2630e8f4890 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.417699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324d284-e56f-40b9-a911-f2630e8f4890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.417994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324d284-e56f-40b9-a911-f2630e8f4890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.418698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324d284-e56f-40b9-a911-f2630e8f4890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:35.420638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324d284-e56f-40b9-a911-f2630e8f4890 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:35.461252 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1345/2706] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:35 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:35.462270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64c98-5c72-4856-8018-4e39926ea958 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:35.476400 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64c98-5c72-4856-8018-4e39926ea958 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:35.501507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:35.550980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b68d05-740b-4cdf-b931-71f975832c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:35.551641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b68d05-740b-4cdf-b931-71f975832c53 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.551934 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b68d05-740b-4cdf-b931-71f975832c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.552211 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b68d05-740b-4cdf-b931-71f975832c53 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.552936 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b68d05-740b-4cdf-b931-71f975832c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:35.554961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b68d05-740b-4cdf-b931-71f975832c53 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:35.578576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1362/2707] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:35 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:35.582823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324d284-e56f-40b9-a911-f2630e8f4890 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:35.590650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:35.596291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324d284-e56f-40b9-a911-f2630e8f4890 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:35.604943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e023b-2820-45aa-b343-274a06b86df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:35.605698 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e023b-2820-45aa-b343-274a06b86df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.606011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e023b-2820-45aa-b343-274a06b86df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.606258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e023b-2820-45aa-b343-274a06b86df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.606992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e023b-2820-45aa-b343-274a06b86df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:35.609265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e023b-2820-45aa-b343-274a06b86df1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:35.621526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1346/2708] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:35.626670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b68d05-740b-4cdf-b931-71f975832c53 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:35.637392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b68d05-740b-4cdf-b931-71f975832c53 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:35.644169 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41c9a0-a0e4-42b2-8e08-9b4c269b17b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:35.644908 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c9a0-a0e4-42b2-8e08-9b4c269b17b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.645220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c9a0-a0e4-42b2-8e08-9b4c269b17b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.645508 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c9a0-a0e4-42b2-8e08-9b4c269b17b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.646500 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41c9a0-a0e4-42b2-8e08-9b4c269b17b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:35.648009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41c9a0-a0e4-42b2-8e08-9b4c269b17b2 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:35.667860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1363/2709] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:35.672454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e023b-2820-45aa-b343-274a06b86df1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:35.685447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e023b-2820-45aa-b343-274a06b86df1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:35.691369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23e221-1752-4d7a-af1f-af9c2b3cb2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:35.692346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e221-1752-4d7a-af1f-af9c2b3cb2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.692845 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e221-1752-4d7a-af1f-af9c2b3cb2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.692977 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e221-1752-4d7a-af1f-af9c2b3cb2a6 admin admin] PATH_INFO: `/v3/projects/99fd94e64d03491aa83c7f80cd08834a/users/b33ee38bdb7c49e1b3c87118b246d97b/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.713895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23e221-1752-4d7a-af1f-af9c2b3cb2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fd94e64d03491aa83c7f80cd08834a, user_id=b33ee38bdb7c49e1b3c87118b246d97b, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:35.721730 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23e221-1752-4d7a-af1f-af9c2b3cb2a6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:35.740146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41c9a0-a0e4-42b2-8e08-9b4c269b17b2 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:35.742507 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-be41c9a0-a0e4-42b2-8e08-9b4c269b17b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:35.748501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1347/2710] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:35 2022] PUT /identity/v3/projects/99fd94e64d03491aa83c7f80cd08834a/users/b33ee38bdb7c49e1b3c87118b246d97b/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:35.760061 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f920-2c60-47ba-9395-f88862cbdd8d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.761359 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f920-2c60-47ba-9395-f88862cbdd8d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.761848 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181f920-2c60-47ba-9395-f88862cbdd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.810474 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6181f920-2c60-47ba-9395-f88862cbdd8d None None] MFA Rules not processed for user `b33ee38bdb7c49e1b3c87118b246d97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:35.813619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6181f920-2c60-47ba-9395-f88862cbdd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:35.827454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41c9a0-a0e4-42b2-8e08-9b4c269b17b2 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:35.889356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee2d30-0435-4715-bee8-d3a80d865313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:35.890078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee2d30-0435-4715-bee8-d3a80d865313 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.890395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee2d30-0435-4715-bee8-d3a80d865313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.890940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee2d30-0435-4715-bee8-d3a80d865313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:35.893018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-23ee2d30-0435-4715-bee8-d3a80d865313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:35.896313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1348/2711] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:35.907527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181f920-2c60-47ba-9395-f88862cbdd8d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:35.909404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6181f920-2c60-47ba-9395-f88862cbdd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:35.964602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee2d30-0435-4715-bee8-d3a80d865313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:35.966100 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee2d30-0435-4715-bee8-d3a80d865313 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:35.976772 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1364/2712] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:22:35.980265 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181f920-2c60-47ba-9395-f88862cbdd8d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:35.988882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1b31e-d10d-4654-be88-dd0224ca0539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:35.989876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1b31e-d10d-4654-be88-dd0224ca0539 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:35.990435 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1b31e-d10d-4654-be88-dd0224ca0539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:35.990954 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1b31e-d10d-4654-be88-dd0224ca0539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:36.002541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1b31e-d10d-4654-be88-dd0224ca0539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:36.004074 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1b31e-d10d-4654-be88-dd0224ca0539 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:36.014620 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1349/2713] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:22:36.034111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee2d30-0435-4715-bee8-d3a80d865313 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:36.044452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee2d30-0435-4715-bee8-d3a80d865313 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:36.050492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:36.051575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:36.051841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:36.052126 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] PATH_INFO: `/v3/users/b33ee38bdb7c49e1b3c87118b246d97b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:36.053452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33ee38bdb7c49e1b3c87118b246d97b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:36.056026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:36.057378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:36.126200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33ee38bdb7c49e1b3c87118b246d97b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:36.138550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33ee38bdb7c49e1b3c87118b246d97b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:36.140200 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33ee38bdb7c49e1b3c87118b246d97b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:36.141123 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33ee38bdb7c49e1b3c87118b246d97b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:36.157176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33ee38bdb7c49e1b3c87118b246d97b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:36.174053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1365/2714] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:36 2022] DELETE /identity/v3/users/b33ee38bdb7c49e1b3c87118b246d97b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:36.178258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8def9-fdf4-44ac-9966-3da59a557caa None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:36.178844 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8def9-fdf4-44ac-9966-3da59a557caa None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:36.179234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8def9-fdf4-44ac-9966-3da59a557caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:36.201727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-11e8def9-fdf4-44ac-9966-3da59a557caa None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:36.204825 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-11e8def9-fdf4-44ac-9966-3da59a557caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:36.298539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1350/2715] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:36.328475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:36.330833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:36.411898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed897e-cc90-44ad-9d60-1c60a7a69923 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:36.423011 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025ab9f-3cd9-46dc-ab53-ff110ca34a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:36.424049 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025ab9f-3cd9-46dc-ab53-ff110ca34a41 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:36.424443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025ab9f-3cd9-46dc-ab53-ff110ca34a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:36.424957 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025ab9f-3cd9-46dc-ab53-ff110ca34a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:36.437753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025ab9f-3cd9-46dc-ab53-ff110ca34a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:36.439656 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025ab9f-3cd9-46dc-ab53-ff110ca34a41 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:36.453177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1366/2716] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:37.088405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8def9-fdf4-44ac-9966-3da59a557caa None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:37.089947 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-11e8def9-fdf4-44ac-9966-3da59a557caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:37.099095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:37.104756 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8def9-fdf4-44ac-9966-3da59a557caa None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:37.111699 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:37.113149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:37.113542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:37.113924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] PATH_INFO: `/v3/projects/99fd94e64d03491aa83c7f80cd08834a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:37.115321 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fd94e64d03491aa83c7f80cd08834a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:37.117536 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:37.217928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fd94e64d03491aa83c7f80cd08834a', 'request_id': 'req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:37.237727 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fd94e64d03491aa83c7f80cd08834a', 'request_id': 'req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:37.248418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fd94e64d03491aa83c7f80cd08834a', 'request_id': 'req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:37.273405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] The token cache is being invalidate because project 99fd94e64d03491aa83c7f80cd08834a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:37.273747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:37.274365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-58a5dc25-9798-40fb-8ec3-49f4a5795d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:37.276020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1351/2717] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:37 2022] DELETE /identity/v3/projects/99fd94e64d03491aa83c7f80cd08834a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:37.281720 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1c800-320d-4710-9b76-26a5d71a8152 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:37.282213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1c800-320d-4710-9b76-26a5d71a8152 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:37.282297 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1c800-320d-4710-9b76-26a5d71a8152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:37.306536 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4fa1c800-320d-4710-9b76-26a5d71a8152 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:37.307763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4fa1c800-320d-4710-9b76-26a5d71a8152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:37.390152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1367/2718] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:37.398233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffa9d1-1441-48ca-bdc5-117f7f6aeffc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:37.398535 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffa9d1-1441-48ca-bdc5-117f7f6aeffc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:37.398815 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffa9d1-1441-48ca-bdc5-117f7f6aeffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:37.433539 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-bbffa9d1-1441-48ca-bdc5-117f7f6aeffc None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:37.434779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-bbffa9d1-1441-48ca-bdc5-117f7f6aeffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:37.458077 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1352/2719] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:37.459416 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1c800-320d-4710-9b76-26a5d71a8152 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:37.474704 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1c800-320d-4710-9b76-26a5d71a8152 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:37.484042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386815f-879a-4ae6-87fb-4fcefe18bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:37.485029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386815f-879a-4ae6-87fb-4fcefe18bba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:37.485332 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386815f-879a-4ae6-87fb-4fcefe18bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:37.485917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386815f-879a-4ae6-87fb-4fcefe18bba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:37.486730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386815f-879a-4ae6-87fb-4fcefe18bba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:37.487008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386815f-879a-4ae6-87fb-4fcefe18bba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:37.488955 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386815f-879a-4ae6-87fb-4fcefe18bba6 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:37.511436 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1368/2720] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:37.515894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffa9d1-1441-48ca-bdc5-117f7f6aeffc None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:37.527130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffa9d1-1441-48ca-bdc5-117f7f6aeffc None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:37.534341 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39928f-4d59-4634-b852-db2e95160e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:37.535656 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39928f-4d59-4634-b852-db2e95160e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:37.536315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39928f-4d59-4634-b852-db2e95160e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:37.536644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39928f-4d59-4634-b852-db2e95160e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:37.537387 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39928f-4d59-4634-b852-db2e95160e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:37.541278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39928f-4d59-4634-b852-db2e95160e7c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:37.589210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1353/2721] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:37 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:37.593185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386815f-879a-4ae6-87fb-4fcefe18bba6 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:37.611691 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386815f-879a-4ae6-87fb-4fcefe18bba6 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:37.617992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:37.740048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8f7d0-5622-433b-80bf-bb4c2799cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:37.741032 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8f7d0-5622-433b-80bf-bb4c2799cc30 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:37.741358 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8f7d0-5622-433b-80bf-bb4c2799cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:37.742272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8f7d0-5622-433b-80bf-bb4c2799cc30 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:37.743101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8f7d0-5622-433b-80bf-bb4c2799cc30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:37.745623 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8f7d0-5622-433b-80bf-bb4c2799cc30 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:37.781556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1369/2722] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:37 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:37.782704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39928f-4d59-4634-b852-db2e95160e7c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:37.793937 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39928f-4d59-4634-b852-db2e95160e7c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:37.801100 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20ddc1-e603-49cd-a762-95ec0aca4365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:37.802085 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ddc1-e603-49cd-a762-95ec0aca4365 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:37.802376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ddc1-e603-49cd-a762-95ec0aca4365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:37.802660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ddc1-e603-49cd-a762-95ec0aca4365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:37.804713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ddc1-e603-49cd-a762-95ec0aca4365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:37.806299 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ddc1-e603-49cd-a762-95ec0aca4365 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:37.818749 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1354/2723] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:37.822804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8f7d0-5622-433b-80bf-bb4c2799cc30 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:37.838041 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8f7d0-5622-433b-80bf-bb4c2799cc30 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:37.845992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668f87d-2469-4ff7-932b-5e66ecd11f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:37.846945 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668f87d-2469-4ff7-932b-5e66ecd11f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:37.848144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668f87d-2469-4ff7-932b-5e66ecd11f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:37.848517 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668f87d-2469-4ff7-932b-5e66ecd11f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:37.849401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668f87d-2469-4ff7-932b-5e66ecd11f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:37.851899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668f87d-2469-4ff7-932b-5e66ecd11f7d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:37.879287 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1370/2724] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:37.883282 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20ddc1-e603-49cd-a762-95ec0aca4365 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:37.897532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20ddc1-e603-49cd-a762-95ec0aca4365 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:37.903000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016a021-fe21-4f1f-a4fa-0abf12882176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:37.903900 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016a021-fe21-4f1f-a4fa-0abf12882176 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:37.904289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016a021-fe21-4f1f-a4fa-0abf12882176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:37.904573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016a021-fe21-4f1f-a4fa-0abf12882176 admin admin] PATH_INFO: `/v3/projects/ec0a5a6eb8e14a10acf27281cf01a1af/users/75f1aec94af1470c80fe0ec9053ba383/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:37.930001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016a021-fe21-4f1f-a4fa-0abf12882176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0a5a6eb8e14a10acf27281cf01a1af, user_id=75f1aec94af1470c80fe0ec9053ba383, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:37.934301 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016a021-fe21-4f1f-a4fa-0abf12882176 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:37.964640 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1355/2725] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:37 2022] PUT /identity/v3/projects/ec0a5a6eb8e14a10acf27281cf01a1af/users/75f1aec94af1470c80fe0ec9053ba383/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:37.975079 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ef100-0af0-4c25-bf56-62f2d322d7ce None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:37.977649 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ef100-0af0-4c25-bf56-62f2d322d7ce None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:37.978053 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ef100-0af0-4c25-bf56-62f2d322d7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:38.032038 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e32ef100-0af0-4c25-bf56-62f2d322d7ce None None] MFA Rules not processed for user `75f1aec94af1470c80fe0ec9053ba383`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:38.033925 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e32ef100-0af0-4c25-bf56-62f2d322d7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:38.176246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1371/2726] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:38.188005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016a021-fe21-4f1f-a4fa-0abf12882176 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:38.190748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f016a021-fe21-4f1f-a4fa-0abf12882176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:38.313755 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016a021-fe21-4f1f-a4fa-0abf12882176 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:38.326574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5e2e-fd71-43dd-80b6-8bdeede6c10a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:38.327348 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5e2e-fd71-43dd-80b6-8bdeede6c10a service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:38.327637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5e2e-fd71-43dd-80b6-8bdeede6c10a service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:38.327918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5e2e-fd71-43dd-80b6-8bdeede6c10a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:38.346946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe5e2e-fd71-43dd-80b6-8bdeede6c10a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:38.348486 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe5e2e-fd71-43dd-80b6-8bdeede6c10a service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:38.369459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1356/2727] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:41.545445 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be414a-3f55-4439-95e1-07d5cdac5abe None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:41.546565 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be414a-3f55-4439-95e1-07d5cdac5abe None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:41.546752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be414a-3f55-4439-95e1-07d5cdac5abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:41.575595 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b7be414a-3f55-4439-95e1-07d5cdac5abe None None] MFA Rules not processed for user `5e2fa25be8de4b88aaad78ce0001791e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:41.576866 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b7be414a-3f55-4439-95e1-07d5cdac5abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:41.688028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1372/2728] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:41.702952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5e2e-fd71-43dd-80b6-8bdeede6c10a service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:41.705369 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-45fe5e2e-fd71-43dd-80b6-8bdeede6c10a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:41.745680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:41.810485 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5e2e-fd71-43dd-80b6-8bdeede6c10a service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:41.818583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc5255-8c17-4203-9dab-b26eaf1bc609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:41.819515 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc5255-8c17-4203-9dab-b26eaf1bc609 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:41.820668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc5255-8c17-4203-9dab-b26eaf1bc609 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:41.820668 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc5255-8c17-4203-9dab-b26eaf1bc609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:41.830917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc5255-8c17-4203-9dab-b26eaf1bc609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:41.832602 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc5255-8c17-4203-9dab-b26eaf1bc609 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:41.851735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1357/2729] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:43.958827 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463919cb-144e-46a2-b537-6f7201a2b453 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:43.959326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463919cb-144e-46a2-b537-6f7201a2b453 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:43.959454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463919cb-144e-46a2-b537-6f7201a2b453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:43.972834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:43.979679 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-463919cb-144e-46a2-b537-6f7201a2b453 None None] MFA Rules not processed for user `5e2fa25be8de4b88aaad78ce0001791e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:43.982592 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-463919cb-144e-46a2-b537-6f7201a2b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:43.993162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1373/2730] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:44.678111 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc5255-8c17-4203-9dab-b26eaf1bc609 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:44.835596 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc5255-8c17-4203-9dab-b26eaf1bc609 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:44.845554 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:44.846762 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:44.847217 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:44.848944 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] PATH_INFO: `/v3/users/75f1aec94af1470c80fe0ec9053ba383` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:44.853082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f1aec94af1470c80fe0ec9053ba383)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:44.855063 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:44.951748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f1aec94af1470c80fe0ec9053ba383'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:44.965918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f1aec94af1470c80fe0ec9053ba383'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:44.966798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f1aec94af1470c80fe0ec9053ba383'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:44.967710 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f1aec94af1470c80fe0ec9053ba383'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.004863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f1aec94af1470c80fe0ec9053ba383'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.021293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1358/2731] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:44 2022] DELETE /identity/v3/users/75f1aec94af1470c80fe0ec9053ba383 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:45.023572 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50580e-a82f-49ec-a80f-9af16126e38c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:45.023572 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50580e-a82f-49ec-a80f-9af16126e38c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:45.023572 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50580e-a82f-49ec-a80f-9af16126e38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:45.048372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:45.050324 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:45.053265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ea50580e-a82f-49ec-a80f-9af16126e38c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:45.054914 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ea50580e-a82f-49ec-a80f-9af16126e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:45.125795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:45.157739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1374/2732] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:45.170588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50580e-a82f-49ec-a80f-9af16126e38c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:45.174244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ea50580e-a82f-49ec-a80f-9af16126e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:45.194287 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19395f-5ab9-4307-b4b5-16256f525cd7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:45.201107 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:45.202413 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:45.203043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:45.203163 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] PATH_INFO: `/v3/users/57bd74ac650548ffae959ed97034c059` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:45.204768 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bd74ac650548ffae959ed97034c059)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:45.206891 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:45.263043 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50580e-a82f-49ec-a80f-9af16126e38c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:45.267504 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a374e3-64db-40b9-a148-cd2892388063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:45.268166 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a374e3-64db-40b9-a148-cd2892388063 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:45.268753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a374e3-64db-40b9-a148-cd2892388063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:45.269217 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a374e3-64db-40b9-a148-cd2892388063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:45.273618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bd74ac650548ffae959ed97034c059'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.282535 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a374e3-64db-40b9-a148-cd2892388063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:45.284482 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a374e3-64db-40b9-a148-cd2892388063 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:45.287365 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bd74ac650548ffae959ed97034c059'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.288356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bd74ac650548ffae959ed97034c059'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.289626 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bd74ac650548ffae959ed97034c059'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.298164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1375/2733] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:45.310840 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bd74ac650548ffae959ed97034c059'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.330269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1359/2734] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:45 2022] DELETE /identity/v3/users/57bd74ac650548ffae959ed97034c059 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:45.605099 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a374e3-64db-40b9-a148-cd2892388063 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:45.616576 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a374e3-64db-40b9-a148-cd2892388063 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:45.702173 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:45.704284 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:45.743362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:45.744252 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:45.744540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:45.744900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] PATH_INFO: `/v3/projects/550e7ce9112b4d0384f3e0cabadb81dd` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:45.748057 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=550e7ce9112b4d0384f3e0cabadb81dd)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:45.750139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:45.811028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f5228-bb85-4967-bb0a-4461bd305827 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:45.814581 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:45.818002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550e7ce9112b4d0384f3e0cabadb81dd', 'request_id': 'req-18b6188e-76fe-408e-bbea-63abb8419d9c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.826556 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550e7ce9112b4d0384f3e0cabadb81dd', 'request_id': 'req-18b6188e-76fe-408e-bbea-63abb8419d9c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.837460 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550e7ce9112b4d0384f3e0cabadb81dd', 'request_id': 'req-18b6188e-76fe-408e-bbea-63abb8419d9c'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.851708 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] The token cache is being invalidate because project 550e7ce9112b4d0384f3e0cabadb81dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:45.852012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.853050 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.854845 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1376/2735] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:45 2022] DELETE /identity/v3/projects/550e7ce9112b4d0384f3e0cabadb81dd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:45.860808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:45.862174 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:45.874995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:45.885869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:45.886933 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:45.887278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:45.887557 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] PATH_INFO: `/v3/projects/ec0a5a6eb8e14a10acf27281cf01a1af` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:45.888833 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0a5a6eb8e14a10acf27281cf01a1af)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:45.890977 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:45.946148 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0a5a6eb8e14a10acf27281cf01a1af', 'request_id': 'req-62fa3dd8-2994-41d1-b386-cc1445f9969c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.946796 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6188e-76fe-408e-bbea-63abb8419d9c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:45.953202 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0a5a6eb8e14a10acf27281cf01a1af', 'request_id': 'req-62fa3dd8-2994-41d1-b386-cc1445f9969c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.959161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0a5a6eb8e14a10acf27281cf01a1af', 'request_id': 'req-62fa3dd8-2994-41d1-b386-cc1445f9969c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.974924 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] The token cache is being invalidate because project ec0a5a6eb8e14a10acf27281cf01a1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:45.975184 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.975785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-62fa3dd8-2994-41d1-b386-cc1445f9969c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:45.977713 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1360/2736] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:45 2022] DELETE /identity/v3/projects/ec0a5a6eb8e14a10acf27281cf01a1af => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:45.984851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64348d3-35f1-4736-b458-0353dfc6309d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:45.985616 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64348d3-35f1-4736-b458-0353dfc6309d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:45.985936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64348d3-35f1-4736-b458-0353dfc6309d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.007915 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e64348d3-35f1-4736-b458-0353dfc6309d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:46.009781 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e64348d3-35f1-4736-b458-0353dfc6309d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:46.038177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:46.040031 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:46.040526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:46.041307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] PATH_INFO: `/v3/users/e1d0eb925f5e46ae81e4dc10f77b8dcd` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.043878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d0eb925f5e46ae81e4dc10f77b8dcd)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:46.047996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:46.088822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1361/2737] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:46.095272 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6e7d8-86af-420c-858a-70d172d40b77 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:46.095733 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6e7d8-86af-420c-858a-70d172d40b77 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:46.096026 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6e7d8-86af-420c-858a-70d172d40b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.117864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-68d6e7d8-86af-420c-858a-70d172d40b77 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:46.119095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-68d6e7d8-86af-420c-858a-70d172d40b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:46.125486 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d0eb925f5e46ae81e4dc10f77b8dcd'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:46.129908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1362/2738] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:22:46.134156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6e7d8-86af-420c-858a-70d172d40b77 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:46.144695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6e7d8-86af-420c-858a-70d172d40b77 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:46.145433 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d0eb925f5e46ae81e4dc10f77b8dcd'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:46.149209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d0eb925f5e46ae81e4dc10f77b8dcd'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:46.149516 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480b556-b17c-450b-ae96-9ebeb62b93ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:46.150142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d0eb925f5e46ae81e4dc10f77b8dcd'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:46.150271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480b556-b17c-450b-ae96-9ebeb62b93ae admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:46.150439 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480b556-b17c-450b-ae96-9ebeb62b93ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:46.150723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480b556-b17c-450b-ae96-9ebeb62b93ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.151573 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480b556-b17c-450b-ae96-9ebeb62b93ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:46.151887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480b556-b17c-450b-ae96-9ebeb62b93ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:46.153517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480b556-b17c-450b-ae96-9ebeb62b93ae admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:46.174688 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d0eb925f5e46ae81e4dc10f77b8dcd'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:46.176178 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1363/2739] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:22:46.180769 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480b556-b17c-450b-ae96-9ebeb62b93ae admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:46.183565 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0480b556-b17c-450b-ae96-9ebeb62b93ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:46.187155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:46.193930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1377/2740] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:45 2022] DELETE /identity/v3/users/e1d0eb925f5e46ae81e4dc10f77b8dcd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:46.212092 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480b556-b17c-450b-ae96-9ebeb62b93ae admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:46.282582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e329ed-3c32-4f8c-8d4b-1c71ff801fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:46.283258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e329ed-3c32-4f8c-8d4b-1c71ff801fae admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:46.283543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e329ed-3c32-4f8c-8d4b-1c71ff801fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:46.283974 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e329ed-3c32-4f8c-8d4b-1c71ff801fae admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.286307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e329ed-3c32-4f8c-8d4b-1c71ff801fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:46.289219 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e329ed-3c32-4f8c-8d4b-1c71ff801fae admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:46.301970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:46.344566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:46.348239 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1364/2741] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:46 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:46.359501 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b05e-c7e6-4a2b-83ef-c0220007f64b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:46.397675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e329ed-3c32-4f8c-8d4b-1c71ff801fae admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:46.399532 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e0e329ed-3c32-4f8c-8d4b-1c71ff801fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:46.441327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d226c5-6ab7-4ea3-be3b-cd7693bf0a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:46.442012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d226c5-6ab7-4ea3-be3b-cd7693bf0a5c admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:46.442297 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d226c5-6ab7-4ea3-be3b-cd7693bf0a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:46.442823 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d226c5-6ab7-4ea3-be3b-cd7693bf0a5c admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.444395 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d226c5-6ab7-4ea3-be3b-cd7693bf0a5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:46.446388 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d226c5-6ab7-4ea3-be3b-cd7693bf0a5c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:46.478354 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1378/2742] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:46 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:46.479352 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d226c5-6ab7-4ea3-be3b-cd7693bf0a5c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:46.491431 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d226c5-6ab7-4ea3-be3b-cd7693bf0a5c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:46.498035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8a5a1-4096-42e0-b101-87296cf5218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:46.498966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8a5a1-4096-42e0-b101-87296cf5218c admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:46.499102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8a5a1-4096-42e0-b101-87296cf5218c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:46.499667 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8a5a1-4096-42e0-b101-87296cf5218c admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.500374 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8a5a1-4096-42e0-b101-87296cf5218c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:46.502820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8a5a1-4096-42e0-b101-87296cf5218c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:46.516079 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e329ed-3c32-4f8c-8d4b-1c71ff801fae admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:46.520256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1379/2743] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:46.521399 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:46.521555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8a5a1-4096-42e0-b101-87296cf5218c admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:46.523268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:46.523561 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:46.524011 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] PATH_INFO: `/v3/projects/8792bc5f57cb433881f8105473ec9714` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.525519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8792bc5f57cb433881f8105473ec9714)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:46.527441 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:46.542368 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8a5a1-4096-42e0-b101-87296cf5218c admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:46.548855 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e171c3b-76b7-4204-9ea9-9b15e47c89d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:46.549605 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e171c3b-76b7-4204-9ea9-9b15e47c89d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:46.549899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e171c3b-76b7-4204-9ea9-9b15e47c89d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:46.550185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e171c3b-76b7-4204-9ea9-9b15e47c89d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.550930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e171c3b-76b7-4204-9ea9-9b15e47c89d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:46.552577 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e171c3b-76b7-4204-9ea9-9b15e47c89d8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:46.570307 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1380/2744] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:22:46.572899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e171c3b-76b7-4204-9ea9-9b15e47c89d8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:46.586865 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8792bc5f57cb433881f8105473ec9714', 'request_id': 'req-ff3de49a-13ff-4d24-b07b-d7a172827209'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:46.588023 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e171c3b-76b7-4204-9ea9-9b15e47c89d8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:46.594401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8792bc5f57cb433881f8105473ec9714', 'request_id': 'req-ff3de49a-13ff-4d24-b07b-d7a172827209'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:46.602325 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8792bc5f57cb433881f8105473ec9714', 'request_id': 'req-ff3de49a-13ff-4d24-b07b-d7a172827209'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:46.625584 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] The token cache is being invalidate because project 8792bc5f57cb433881f8105473ec9714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:46.626066 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:46.627212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ff3de49a-13ff-4d24-b07b-d7a172827209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:46.630139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1365/2745] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:46 2022] DELETE /identity/v3/projects/8792bc5f57cb433881f8105473ec9714 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:46.686982 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4038d9-cc4a-4972-9e24-e11ce0f8c597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:46.687898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4038d9-cc4a-4972-9e24-e11ce0f8c597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:46.688359 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4038d9-cc4a-4972-9e24-e11ce0f8c597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:46.688524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4038d9-cc4a-4972-9e24-e11ce0f8c597 admin admin] PATH_INFO: `/v3/projects/5093cad688254784b10007457257f7a2/users/07a83675efbc4fd59c74eab49f086f94/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.708451 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4038d9-cc4a-4972-9e24-e11ce0f8c597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5093cad688254784b10007457257f7a2, user_id=07a83675efbc4fd59c74eab49f086f94, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:46.711441 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4038d9-cc4a-4972-9e24-e11ce0f8c597 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:46.736713 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1381/2746] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:46 2022] PUT /identity/v3/projects/5093cad688254784b10007457257f7a2/users/07a83675efbc4fd59c74eab49f086f94/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:46.740546 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dbd46-1ff6-4d98-a1f8-9e65d5d46578 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:46.741115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dbd46-1ff6-4d98-a1f8-9e65d5d46578 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:46.741115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dbd46-1ff6-4d98-a1f8-9e65d5d46578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.771732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f70dbd46-1ff6-4d98-a1f8-9e65d5d46578 None None] MFA Rules not processed for user `07a83675efbc4fd59c74eab49f086f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:46.773106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f70dbd46-1ff6-4d98-a1f8-9e65d5d46578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:46.849864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1366/2747] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:46.864170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4038d9-cc4a-4972-9e24-e11ce0f8c597 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:46.865613 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-1d4038d9-cc4a-4972-9e24-e11ce0f8c597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:46.927387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4038d9-cc4a-4972-9e24-e11ce0f8c597 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:46.931015 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae0afa-a0d0-4c5d-820e-4059c48ce0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:46.931673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae0afa-a0d0-4c5d-820e-4059c48ce0ac service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:46.931958 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae0afa-a0d0-4c5d-820e-4059c48ce0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:46.932227 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae0afa-a0d0-4c5d-820e-4059c48ce0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:46.939237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:46.944025 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae0afa-a0d0-4c5d-820e-4059c48ce0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:46.946524 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae0afa-a0d0-4c5d-820e-4059c48ce0ac service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:46.957835 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1382/2748] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:49.549353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dbd46-1ff6-4d98-a1f8-9e65d5d46578 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:49.550751 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f70dbd46-1ff6-4d98-a1f8-9e65d5d46578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:49.564488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:49.620548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dbd46-1ff6-4d98-a1f8-9e65d5d46578 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:49.626992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:49.627687 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:49.627979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:49.628260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] PATH_INFO: `/v3/users/07a83675efbc4fd59c74eab49f086f94` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:49.629523 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07a83675efbc4fd59c74eab49f086f94)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:49.631459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:49.679232 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07a83675efbc4fd59c74eab49f086f94'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:49.687393 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07a83675efbc4fd59c74eab49f086f94'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:49.688208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07a83675efbc4fd59c74eab49f086f94'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:49.689117 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07a83675efbc4fd59c74eab49f086f94'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:49.701624 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07a83675efbc4fd59c74eab49f086f94'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:49.714606 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1367/2749] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:49 2022] DELETE /identity/v3/users/07a83675efbc4fd59c74eab49f086f94 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:49.719528 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1765b3-1b9d-4fb1-b63e-8092e81e684b None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:49.720042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1765b3-1b9d-4fb1-b63e-8092e81e684b None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:49.720232 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1765b3-1b9d-4fb1-b63e-8092e81e684b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:49.737276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-af1765b3-1b9d-4fb1-b63e-8092e81e684b None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:49.738488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-af1765b3-1b9d-4fb1-b63e-8092e81e684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:49.796455 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1383/2750] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:49.806018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:49.807514 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:49.865819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840cceb-9113-46ee-a819-3669630b5da7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:49.869508 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f134d33-9abe-47a3-a4fd-cce728f9bf71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:49.870145 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134d33-9abe-47a3-a4fd-cce728f9bf71 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:49.870431 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134d33-9abe-47a3-a4fd-cce728f9bf71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:49.870708 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134d33-9abe-47a3-a4fd-cce728f9bf71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:49.880638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f134d33-9abe-47a3-a4fd-cce728f9bf71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:49.882069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f134d33-9abe-47a3-a4fd-cce728f9bf71 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:49.892364 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1368/2751] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:50.161878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1765b3-1b9d-4fb1-b63e-8092e81e684b None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:50.163368 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-af1765b3-1b9d-4fb1-b63e-8092e81e684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:50.176425 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1765b3-1b9d-4fb1-b63e-8092e81e684b None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:50.181035 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:50.181903 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:50.182187 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:50.182465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] PATH_INFO: `/v3/projects/5093cad688254784b10007457257f7a2` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:50.183652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5093cad688254784b10007457257f7a2)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:50.185762 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:50.232254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5093cad688254784b10007457257f7a2', 'request_id': 'req-bec30f51-ab96-41fb-9335-0ba635c5a6de'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:50.239847 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5093cad688254784b10007457257f7a2', 'request_id': 'req-bec30f51-ab96-41fb-9335-0ba635c5a6de'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:50.248028 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5093cad688254784b10007457257f7a2', 'request_id': 'req-bec30f51-ab96-41fb-9335-0ba635c5a6de'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:50.259668 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] The token cache is being invalidate because project 5093cad688254784b10007457257f7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:50.259953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:50.262804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-bec30f51-ab96-41fb-9335-0ba635c5a6de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:50.264465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1384/2752] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:50 2022] DELETE /identity/v3/projects/5093cad688254784b10007457257f7a2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:50.269386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5eb91-f56b-4eed-bd4a-08ee0bf5ee55 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:50.269386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5eb91-f56b-4eed-bd4a-08ee0bf5ee55 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:50.269929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5eb91-f56b-4eed-bd4a-08ee0bf5ee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:50.287990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-07e5eb91-f56b-4eed-bd4a-08ee0bf5ee55 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:50.289267 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-07e5eb91-f56b-4eed-bd4a-08ee0bf5ee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:50.320925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:50.353965 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1369/2753] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:50.362284 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311bf0-9cf4-4f18-a53e-9fa46c03fe2c None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:50.362686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311bf0-9cf4-4f18-a53e-9fa46c03fe2c None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:50.363031 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311bf0-9cf4-4f18-a53e-9fa46c03fe2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:50.382411 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-7a311bf0-9cf4-4f18-a53e-9fa46c03fe2c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:50.383737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7a311bf0-9cf4-4f18-a53e-9fa46c03fe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:50.392767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1385/2754] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:50.397792 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5eb91-f56b-4eed-bd4a-08ee0bf5ee55 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:50.409212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5eb91-f56b-4eed-bd4a-08ee0bf5ee55 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:50.413880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b061f-8dcb-4179-a3db-ad6c13536b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:50.414567 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b061f-8dcb-4179-a3db-ad6c13536b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:50.414830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b061f-8dcb-4179-a3db-ad6c13536b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:50.415105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b061f-8dcb-4179-a3db-ad6c13536b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:50.415834 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b061f-8dcb-4179-a3db-ad6c13536b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:50.416140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b061f-8dcb-4179-a3db-ad6c13536b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:50.418050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b061f-8dcb-4179-a3db-ad6c13536b0e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:50.431726 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1370/2755] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:50.436215 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311bf0-9cf4-4f18-a53e-9fa46c03fe2c None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:50.446205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311bf0-9cf4-4f18-a53e-9fa46c03fe2c None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:50.451283 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd23f8-1aad-465e-a2ce-f620a7f9592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:50.452427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd23f8-1aad-465e-a2ce-f620a7f9592d admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:50.452763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd23f8-1aad-465e-a2ce-f620a7f9592d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:50.453046 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd23f8-1aad-465e-a2ce-f620a7f9592d admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:50.453889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd23f8-1aad-465e-a2ce-f620a7f9592d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:50.455661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd23f8-1aad-465e-a2ce-f620a7f9592d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:50.485110 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1386/2756] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:50 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:50.488863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b061f-8dcb-4179-a3db-ad6c13536b0e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:50.499386 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b061f-8dcb-4179-a3db-ad6c13536b0e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:50.557657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e75323-fc99-4000-be70-4e970ba7988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:50.558316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75323-fc99-4000-be70-4e970ba7988f admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:50.558605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75323-fc99-4000-be70-4e970ba7988f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:50.558880 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75323-fc99-4000-be70-4e970ba7988f admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:50.559574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e75323-fc99-4000-be70-4e970ba7988f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:50.561758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e75323-fc99-4000-be70-4e970ba7988f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:50.586610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1371/2757] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:50 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:22:50.587889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd23f8-1aad-465e-a2ce-f620a7f9592d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:50.600636 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd23f8-1aad-465e-a2ce-f620a7f9592d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:50.605559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84806783-485c-4b36-a674-8c77125988c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:50.606233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806783-485c-4b36-a674-8c77125988c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:50.606526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806783-485c-4b36-a674-8c77125988c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:50.606792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806783-485c-4b36-a674-8c77125988c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:50.607522 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84806783-485c-4b36-a674-8c77125988c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:50.609778 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84806783-485c-4b36-a674-8c77125988c8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:50.621530 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1387/2758] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:50.626017 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e75323-fc99-4000-be70-4e970ba7988f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:50.636392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e75323-fc99-4000-be70-4e970ba7988f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:50.642134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c241b-9b3b-45e4-8449-d82f1ca1b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:50.642835 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c241b-9b3b-45e4-8449-d82f1ca1b8df admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:50.643124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c241b-9b3b-45e4-8449-d82f1ca1b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:50.643407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c241b-9b3b-45e4-8449-d82f1ca1b8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:50.644409 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c241b-9b3b-45e4-8449-d82f1ca1b8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:50.645789 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c241b-9b3b-45e4-8449-d82f1ca1b8df admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:50.657076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1372/2759] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:50.661242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84806783-485c-4b36-a674-8c77125988c8 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:50.671992 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84806783-485c-4b36-a674-8c77125988c8 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:50.677201 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04a158-98bc-4c6c-992d-88a1fc78c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:50.678089 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a158-98bc-4c6c-992d-88a1fc78c628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:50.678557 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a158-98bc-4c6c-992d-88a1fc78c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:50.678840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a158-98bc-4c6c-992d-88a1fc78c628 admin admin] PATH_INFO: `/v3/projects/b4243090539e46ac86f2ae7ebbf8c11e/users/321fc927534c41de911f3fb477a74865/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:50.695224 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04a158-98bc-4c6c-992d-88a1fc78c628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4243090539e46ac86f2ae7ebbf8c11e, user_id=321fc927534c41de911f3fb477a74865, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:50.698003 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04a158-98bc-4c6c-992d-88a1fc78c628 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:50.712969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1388/2760] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:50 2022] PUT /identity/v3/projects/b4243090539e46ac86f2ae7ebbf8c11e/users/321fc927534c41de911f3fb477a74865/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:50.725295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a906a-9888-4207-b573-8129d5a340f7 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:50.725652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a906a-9888-4207-b573-8129d5a340f7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:50.725939 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a906a-9888-4207-b573-8129d5a340f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:50.753470 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d12a906a-9888-4207-b573-8129d5a340f7 None None] MFA Rules not processed for user `321fc927534c41de911f3fb477a74865`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:50.755403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d12a906a-9888-4207-b573-8129d5a340f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:50.822805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1373/2761] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:50.835139 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04a158-98bc-4c6c-992d-88a1fc78c628 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:50.836932 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ee04a158-98bc-4c6c-992d-88a1fc78c628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:50.851943 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:50.904510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04a158-98bc-4c6c-992d-88a1fc78c628 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:50.909167 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00626832-969d-487a-93dc-12413ffac2e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:50.909820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626832-969d-487a-93dc-12413ffac2e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:50.910102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626832-969d-487a-93dc-12413ffac2e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:50.910377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626832-969d-487a-93dc-12413ffac2e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:50.919419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00626832-969d-487a-93dc-12413ffac2e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:50.921977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00626832-969d-487a-93dc-12413ffac2e9 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:50.931675 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1389/2762] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:50.956871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a906a-9888-4207-b573-8129d5a340f7 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:50.990329 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:51.029355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a906a-9888-4207-b573-8129d5a340f7 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:51.035071 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:51.035992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:51.036276 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:51.036551 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] PATH_INFO: `/v3/users/321fc927534c41de911f3fb477a74865` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:51.037764 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=321fc927534c41de911f3fb477a74865)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:51.039673 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:51.086454 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321fc927534c41de911f3fb477a74865'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:51.094642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321fc927534c41de911f3fb477a74865'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:51.095190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321fc927534c41de911f3fb477a74865'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:51.095793 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321fc927534c41de911f3fb477a74865'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:51.107347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321fc927534c41de911f3fb477a74865'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:51.120226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1374/2763] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:22:50 2022] DELETE /identity/v3/users/321fc927534c41de911f3fb477a74865 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:51.124728 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d01f4-eb08-45d8-afad-5d984d02a52e None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:51.125026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d01f4-eb08-45d8-afad-5d984d02a52e None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:51.125312 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d01f4-eb08-45d8-afad-5d984d02a52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:51.142213 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-130d01f4-eb08-45d8-afad-5d984d02a52e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:51.143449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-130d01f4-eb08-45d8-afad-5d984d02a52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:51.203062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1390/2764] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:51.212544 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:51.213968 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:51.273572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691406fa-a326-46cc-b405-7197856240dd admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:51.277208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc699c-22ff-4ac2-9d25-be8623867a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:51.277854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc699c-22ff-4ac2-9d25-be8623867a2e service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:51.278141 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc699c-22ff-4ac2-9d25-be8623867a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:51.278422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc699c-22ff-4ac2-9d25-be8623867a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:51.287618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc699c-22ff-4ac2-9d25-be8623867a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:51.289091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc699c-22ff-4ac2-9d25-be8623867a2e service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:51.298664 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1375/2765] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:22:51.571896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d01f4-eb08-45d8-afad-5d984d02a52e None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:51.573365 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-130d01f4-eb08-45d8-afad-5d984d02a52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:51.585684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d01f4-eb08-45d8-afad-5d984d02a52e None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:51.590901 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:51.591286 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:51.592049 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:51.592378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] PATH_INFO: `/v3/projects/b4243090539e46ac86f2ae7ebbf8c11e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:51.594337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4243090539e46ac86f2ae7ebbf8c11e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:51.596270 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:51.645231 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4243090539e46ac86f2ae7ebbf8c11e', 'request_id': 'req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:51.651154 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4243090539e46ac86f2ae7ebbf8c11e', 'request_id': 'req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:51.659421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4243090539e46ac86f2ae7ebbf8c11e', 'request_id': 'req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:51.669860 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] The token cache is being invalidate because project b4243090539e46ac86f2ae7ebbf8c11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:22:51.670145 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:51.670804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d5f75a07-36b8-4755-b758-7ae81bfc9cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:22:51.672515 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1391/2766] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:22:51 2022] DELETE /identity/v3/projects/b4243090539e46ac86f2ae7ebbf8c11e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:22:51.677407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347fbf2-12be-404f-a567-bba50ac119b3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:51.677908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347fbf2-12be-404f-a567-bba50ac119b3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:51.678012 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347fbf2-12be-404f-a567-bba50ac119b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:51.696131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e347fbf2-12be-404f-a567-bba50ac119b3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:51.697375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e347fbf2-12be-404f-a567-bba50ac119b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:51.743660 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:51.759350 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1376/2767] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:51.767715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f96d8-7f59-4c22-9f31-3bb045775830 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:51.768009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f96d8-7f59-4c22-9f31-3bb045775830 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:51.768291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f96d8-7f59-4c22-9f31-3bb045775830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:51.787121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-db0f96d8-7f59-4c22-9f31-3bb045775830 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:51.788325 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-db0f96d8-7f59-4c22-9f31-3bb045775830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:51.796794 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1392/2768] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:51.801009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347fbf2-12be-404f-a567-bba50ac119b3 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:51.810643 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347fbf2-12be-404f-a567-bba50ac119b3 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:51.816097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71e0e5-22c8-4b1f-b6ed-ba4e211a2a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:51.816786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71e0e5-22c8-4b1f-b6ed-ba4e211a2a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:51.817077 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71e0e5-22c8-4b1f-b6ed-ba4e211a2a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:51.817358 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71e0e5-22c8-4b1f-b6ed-ba4e211a2a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:51.818082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71e0e5-22c8-4b1f-b6ed-ba4e211a2a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:22:51.818391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71e0e5-22c8-4b1f-b6ed-ba4e211a2a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:51.819993 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71e0e5-22c8-4b1f-b6ed-ba4e211a2a88 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:51.832147 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1377/2769] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:22:51.836097 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f96d8-7f59-4c22-9f31-3bb045775830 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:51.845333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f96d8-7f59-4c22-9f31-3bb045775830 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:51.849953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda62fd-fa77-47d1-95ae-805e2ec499fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:51.850618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda62fd-fa77-47d1-95ae-805e2ec499fc admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:51.850923 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda62fd-fa77-47d1-95ae-805e2ec499fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:51.851199 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda62fd-fa77-47d1-95ae-805e2ec499fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:51.851912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda62fd-fa77-47d1-95ae-805e2ec499fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:51.853823 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda62fd-fa77-47d1-95ae-805e2ec499fc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:51.878785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1393/2770] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:22:51 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:51.882992 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71e0e5-22c8-4b1f-b6ed-ba4e211a2a88 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:51.893795 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71e0e5-22c8-4b1f-b6ed-ba4e211a2a88 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:51.951851 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc08fe9-2256-47d6-beea-76b8fa9cffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:51.953262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc08fe9-2256-47d6-beea-76b8fa9cffc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:51.953550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc08fe9-2256-47d6-beea-76b8fa9cffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:51.953861 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc08fe9-2256-47d6-beea-76b8fa9cffc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:51.954568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc08fe9-2256-47d6-beea-76b8fa9cffc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:51.956739 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc08fe9-2256-47d6-beea-76b8fa9cffc0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:51.982151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1378/2771] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:22:51 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:22:51.983782 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda62fd-fa77-47d1-95ae-805e2ec499fc admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:51.994146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda62fd-fa77-47d1-95ae-805e2ec499fc admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:52.000858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9c083-2dfe-41bc-9f0d-17a9225e0e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:52.001555 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9c083-2dfe-41bc-9f0d-17a9225e0e9a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:52.001841 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9c083-2dfe-41bc-9f0d-17a9225e0e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:52.002117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9c083-2dfe-41bc-9f0d-17a9225e0e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:52.002849 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9c083-2dfe-41bc-9f0d-17a9225e0e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:52.004457 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9c083-2dfe-41bc-9f0d-17a9225e0e9a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:52.010080 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:52.020004 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1394/2772] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:52.021686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc08fe9-2256-47d6-beea-76b8fa9cffc0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:52.032076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc08fe9-2256-47d6-beea-76b8fa9cffc0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:52.036930 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474cab7-8e7a-4da9-9f9d-b3e4e4406fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:52.037601 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474cab7-8e7a-4da9-9f9d-b3e4e4406fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:52.037890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474cab7-8e7a-4da9-9f9d-b3e4e4406fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:52.038171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474cab7-8e7a-4da9-9f9d-b3e4e4406fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:52.038908 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474cab7-8e7a-4da9-9f9d-b3e4e4406fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:52.041065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474cab7-8e7a-4da9-9f9d-b3e4e4406fc7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:52.051140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1379/2773] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:22:52.055303 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9c083-2dfe-41bc-9f0d-17a9225e0e9a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:52.066167 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9c083-2dfe-41bc-9f0d-17a9225e0e9a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:52.070870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee432-8601-4059-9509-df34eb7c751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:52.071740 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee432-8601-4059-9509-df34eb7c751e admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:52.072019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee432-8601-4059-9509-df34eb7c751e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:52.072293 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee432-8601-4059-9509-df34eb7c751e admin admin] PATH_INFO: `/v3/projects/ca298b1e03ff4a53b15b9f8532de2e9d/users/31df0ae3421a4559b0aab50d5f8ef542/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:52.087889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eee432-8601-4059-9509-df34eb7c751e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca298b1e03ff4a53b15b9f8532de2e9d, user_id=31df0ae3421a4559b0aab50d5f8ef542, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:52.090588 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eee432-8601-4059-9509-df34eb7c751e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:52.104604 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1395/2774] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:22:52 2022] PUT /identity/v3/projects/ca298b1e03ff4a53b15b9f8532de2e9d/users/31df0ae3421a4559b0aab50d5f8ef542/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:22:52.114977 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab4535-5224-4d6e-85a5-49584f5ba9c1 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:52.115273 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab4535-5224-4d6e-85a5-49584f5ba9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:52.115583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab4535-5224-4d6e-85a5-49584f5ba9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:52.143347 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-31ab4535-5224-4d6e-85a5-49584f5ba9c1 None None] MFA Rules not processed for user `31df0ae3421a4559b0aab50d5f8ef542`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:22:52.144547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-31ab4535-5224-4d6e-85a5-49584f5ba9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:52.206762 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1380/2775] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:22:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:22:52.217272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee432-8601-4059-9509-df34eb7c751e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:22:52.219086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-04eee432-8601-4059-9509-df34eb7c751e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:22:52.275724 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee432-8601-4059-9509-df34eb7c751e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:22:52.279471 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7f261-2a8e-41a4-9237-5ffd36927e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:22:52.280143 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7f261-2a8e-41a4-9237-5ffd36927e7a service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:22:52.280432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7f261-2a8e-41a4-9237-5ffd36927e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:22:52.280831 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7f261-2a8e-41a4-9237-5ffd36927e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:22:52.289249 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7f261-2a8e-41a4-9237-5ffd36927e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:22:52.290707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7f261-2a8e-41a4-9237-5ffd36927e7a service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:22:52.300335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1396/2776] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:22:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:02.033526 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab4535-5224-4d6e-85a5-49584f5ba9c1 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:02.083416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:02.099357 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab4535-5224-4d6e-85a5-49584f5ba9c1 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:02.103833 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:02.104723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:02.105005 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:02.105281 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] PATH_INFO: `/v3/users/31df0ae3421a4559b0aab50d5f8ef542` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:02.106447 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31df0ae3421a4559b0aab50d5f8ef542)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:02.109467 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:02.156172 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31df0ae3421a4559b0aab50d5f8ef542'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:02.164296 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31df0ae3421a4559b0aab50d5f8ef542'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:02.165157 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31df0ae3421a4559b0aab50d5f8ef542'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:02.165830 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31df0ae3421a4559b0aab50d5f8ef542'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:02.178610 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31df0ae3421a4559b0aab50d5f8ef542'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:02.191130 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1381/2777] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:23:02 2022] DELETE /identity/v3/users/31df0ae3421a4559b0aab50d5f8ef542 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:02.195496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b752e0-b1f1-4e3a-b2e4-7f68f535d8a8 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:02.195961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b752e0-b1f1-4e3a-b2e4-7f68f535d8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:02.196085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b752e0-b1f1-4e3a-b2e4-7f68f535d8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:02.213331 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-46b752e0-b1f1-4e3a-b2e4-7f68f535d8a8 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:23:02.214660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-46b752e0-b1f1-4e3a-b2e4-7f68f535d8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:02.272526 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1397/2778] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:23:02.282960 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:02.284379 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:02.348248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4add1a-174f-4f7e-b6a2-ae100ba8fbd0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:02.351963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5317f-c380-45ee-87cf-4498814f6621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:02.352635 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5317f-c380-45ee-87cf-4498814f6621 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:02.352931 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5317f-c380-45ee-87cf-4498814f6621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:02.353215 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5317f-c380-45ee-87cf-4498814f6621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:02.362804 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5317f-c380-45ee-87cf-4498814f6621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:02.364236 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5317f-c380-45ee-87cf-4498814f6621 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:02.373709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1382/2779] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:23:02.640960 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b752e0-b1f1-4e3a-b2e4-7f68f535d8a8 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:23:02.642494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-46b752e0-b1f1-4e3a-b2e4-7f68f535d8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:23:02.656686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b752e0-b1f1-4e3a-b2e4-7f68f535d8a8 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:23:02.661351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:23:02.662233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:23:02.662517 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:23:02.662798 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] PATH_INFO: `/v3/projects/ca298b1e03ff4a53b15b9f8532de2e9d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:23:02.664086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca298b1e03ff4a53b15b9f8532de2e9d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:23:02.666118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:23:02.714819 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca298b1e03ff4a53b15b9f8532de2e9d', 'request_id': 'req-ec435991-5d92-4c6b-b50c-61a5f93ddea7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:02.721756 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca298b1e03ff4a53b15b9f8532de2e9d', 'request_id': 'req-ec435991-5d92-4c6b-b50c-61a5f93ddea7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:02.729066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca298b1e03ff4a53b15b9f8532de2e9d', 'request_id': 'req-ec435991-5d92-4c6b-b50c-61a5f93ddea7'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:02.740102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] The token cache is being invalidate because project ca298b1e03ff4a53b15b9f8532de2e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:23:02.740450 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:02.741193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:23:02.743087 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1398/2780] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:23:02 2022] DELETE /identity/v3/projects/ca298b1e03ff4a53b15b9f8532de2e9d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:23:12.369480 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:12.737026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:13.438658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5317f-c380-45ee-87cf-4498814f6621 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:13.440090 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-74d5317f-c380-45ee-87cf-4498814f6621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:13.451949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5317f-c380-45ee-87cf-4498814f6621 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:13.501072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a809b47-e897-40ad-9c49-240231091bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:13.501719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a809b47-e897-40ad-9c49-240231091bbd service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:13.502008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a809b47-e897-40ad-9c49-240231091bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:13.502293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a809b47-e897-40ad-9c49-240231091bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:13.504849 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6a809b47-e897-40ad-9c49-240231091bbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:13.514121 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a809b47-e897-40ad-9c49-240231091bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:13.515572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a809b47-e897-40ad-9c49-240231091bbd service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:13.524583 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1383/2781] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:24:15.059793 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:15.061242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:15.118625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec435991-5d92-4c6b-b50c-61a5f93ddea7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:15.122272 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea92058-24a9-444c-b2df-41d67b2fa822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:15.122920 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92058-24a9-444c-b2df-41d67b2fa822 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:15.123209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92058-24a9-444c-b2df-41d67b2fa822 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:15.123489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92058-24a9-444c-b2df-41d67b2fa822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:15.125260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fea92058-24a9-444c-b2df-41d67b2fa822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:15.195838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea92058-24a9-444c-b2df-41d67b2fa822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:15.197318 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea92058-24a9-444c-b2df-41d67b2fa822 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:15.208861 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1399/2782] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:18.990518 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a809b47-e897-40ad-9c49-240231091bbd service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:24:18.991837 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6a809b47-e897-40ad-9c49-240231091bbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:19.002295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a809b47-e897-40ad-9c49-240231091bbd service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:24:19.006656 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d669ee-5514-4ded-81bc-22403626ad40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:24:19.007300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d669ee-5514-4ded-81bc-22403626ad40 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:24:19.007587 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d669ee-5514-4ded-81bc-22403626ad40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:24:19.007868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d669ee-5514-4ded-81bc-22403626ad40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:24:19.009659 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-54d669ee-5514-4ded-81bc-22403626ad40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:24:19.023134 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d669ee-5514-4ded-81bc-22403626ad40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:24:19.024556 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d669ee-5514-4ded-81bc-22403626ad40 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:24:19.035638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1384/2783] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:24:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:24:25.203313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=54 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:29.030568 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=32 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:22.700022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea92058-24a9-444c-b2df-41d67b2fa822 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:22.701459 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-fea92058-24a9-444c-b2df-41d67b2fa822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:22.842707 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea92058-24a9-444c-b2df-41d67b2fa822 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:22.849544 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95226515-26d7-41b4-bc8d-db48287e1de9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:22.850212 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95226515-26d7-41b4-bc8d-db48287e1de9 service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:22.850505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95226515-26d7-41b4-bc8d-db48287e1de9 service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:22.850790 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95226515-26d7-41b4-bc8d-db48287e1de9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:22.852662 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-95226515-26d7-41b4-bc8d-db48287e1de9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:22.865115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95226515-26d7-41b4-bc8d-db48287e1de9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:22.866705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95226515-26d7-41b4-bc8d-db48287e1de9 service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:22.876718 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1400/2784] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:26:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:26:32.872315 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=63 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:49.553242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d669ee-5514-4ded-81bc-22403626ad40 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:49.555083 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-54d669ee-5514-4ded-81bc-22403626ad40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:49.638829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d669ee-5514-4ded-81bc-22403626ad40 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:49.649609 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bc17e-cb31-4f89-9d8f-2be8405069be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:49.650377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bc17e-cb31-4f89-9d8f-2be8405069be service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:49.650791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bc17e-cb31-4f89-9d8f-2be8405069be service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:49.651118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bc17e-cb31-4f89-9d8f-2be8405069be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:49.653197 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-465bc17e-cb31-4f89-9d8f-2be8405069be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:49.666774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bc17e-cb31-4f89-9d8f-2be8405069be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:49.668654 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bc17e-cb31-4f89-9d8f-2be8405069be service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:49.682657 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1385/2785] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:26:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:26:53.245890 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638820e-bc45-438a-ad0a-4eaffe53db4f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:53.246392 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638820e-bc45-438a-ad0a-4eaffe53db4f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:53.246503 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638820e-bc45-438a-ad0a-4eaffe53db4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:53.263386 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-b638820e-bc45-438a-ad0a-4eaffe53db4f None None] MFA Rules not processed for user `5e2fa25be8de4b88aaad78ce0001791e`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:26:53.264584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-b638820e-bc45-438a-ad0a-4eaffe53db4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:53.319465 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1401/2786] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:26:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:26:53.622695 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bc17e-cb31-4f89-9d8f-2be8405069be service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:53.624115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-465bc17e-cb31-4f89-9d8f-2be8405069be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:53.657973 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bc17e-cb31-4f89-9d8f-2be8405069be service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:53.661662 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868c3e2-6449-4bc8-a752-a35f521f26d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:53.662315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868c3e2-6449-4bc8-a752-a35f521f26d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:53.662588 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868c3e2-6449-4bc8-a752-a35f521f26d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:53.662869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868c3e2-6449-4bc8-a752-a35f521f26d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:53.664642 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5868c3e2-6449-4bc8-a752-a35f521f26d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:53.674328 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868c3e2-6449-4bc8-a752-a35f521f26d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:53.675741 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868c3e2-6449-4bc8-a752-a35f521f26d7 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:53.683846 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1386/2787] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:26:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:26:54.008193 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638820e-bc45-438a-ad0a-4eaffe53db4f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:26:54.020371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638820e-bc45-438a-ad0a-4eaffe53db4f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:26:54.025583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a0679-2f3a-43f9-a98e-b03d91402a36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:26:54.026237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a0679-2f3a-43f9-a98e-b03d91402a36 service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:26:54.026520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a0679-2f3a-43f9-a98e-b03d91402a36 service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:26:54.026801 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a0679-2f3a-43f9-a98e-b03d91402a36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:26:54.028630 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5b4a0679-2f3a-43f9-a98e-b03d91402a36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:26:54.040672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a0679-2f3a-43f9-a98e-b03d91402a36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:26:54.042530 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a0679-2f3a-43f9-a98e-b03d91402a36 service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:26:54.056954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1402/2788] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:26:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:27:03.680118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=46 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:04.048427 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=31 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:06.074248 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868c3e2-6449-4bc8-a752-a35f521f26d7 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:27:06.075790 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5868c3e2-6449-4bc8-a752-a35f521f26d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:27:06.119370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868c3e2-6449-4bc8-a752-a35f521f26d7 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:27:06.129135 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3deb4-1513-45ee-bea4-a1cb19b9a704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:27:06.130432 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3deb4-1513-45ee-bea4-a1cb19b9a704 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:27:06.130716 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3deb4-1513-45ee-bea4-a1cb19b9a704 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:27:06.130994 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3deb4-1513-45ee-bea4-a1cb19b9a704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:27:06.133618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-45c3deb4-1513-45ee-bea4-a1cb19b9a704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:27:06.146634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3deb4-1513-45ee-bea4-a1cb19b9a704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:27:06.148209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3deb4-1513-45ee-bea4-a1cb19b9a704 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:27:06.159531 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1387/2789] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:27:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:27:10.164315 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a0679-2f3a-43f9-a98e-b03d91402a36 service placement] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:27:10.179922 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a0679-2f3a-43f9-a98e-b03d91402a36 service placement] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:27:10.185330 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe361f3-5e7c-4851-aca7-28eb0cd43105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:27:10.185996 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe361f3-5e7c-4851-aca7-28eb0cd43105 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:27:10.186278 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe361f3-5e7c-4851-aca7-28eb0cd43105 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:27:10.186554 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe361f3-5e7c-4851-aca7-28eb0cd43105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:27:10.188298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-bfe361f3-5e7c-4851-aca7-28eb0cd43105 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:27:10.202352 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe361f3-5e7c-4851-aca7-28eb0cd43105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:27:10.203952 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe361f3-5e7c-4851-aca7-28eb0cd43105 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:27:10.215219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1403/2790] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:27:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:27:16.154271 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=15 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:20.210785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:13.626709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3deb4-1513-45ee-bea4-a1cb19b9a704 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:13.638820 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3deb4-1513-45ee-bea4-a1cb19b9a704 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:13.644242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cf3c9-aba6-4a34-9f0f-e3edcb9acec6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:13.644936 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cf3c9-aba6-4a34-9f0f-e3edcb9acec6 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:13.645224 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cf3c9-aba6-4a34-9f0f-e3edcb9acec6 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:13.645503 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cf3c9-aba6-4a34-9f0f-e3edcb9acec6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:13.647233 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-078cf3c9-aba6-4a34-9f0f-e3edcb9acec6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:13.657669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cf3c9-aba6-4a34-9f0f-e3edcb9acec6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:13.659250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cf3c9-aba6-4a34-9f0f-e3edcb9acec6 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:13.669315 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1388/2791] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:28:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:28:23.663976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:33.558327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe361f3-5e7c-4851-aca7-28eb0cd43105 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:33.568559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe361f3-5e7c-4851-aca7-28eb0cd43105 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:33.572233 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a186b-6782-4149-b867-5e03a994b04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:33.572905 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a186b-6782-4149-b867-5e03a994b04f service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:33.573194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a186b-6782-4149-b867-5e03a994b04f service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:33.573475 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a186b-6782-4149-b867-5e03a994b04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:33.576153 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c24a186b-6782-4149-b867-5e03a994b04f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:33.660429 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a186b-6782-4149-b867-5e03a994b04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:33.661923 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a186b-6782-4149-b867-5e03a994b04f service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:33.680898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1404/2792] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:28:36.708516 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cf3c9-aba6-4a34-9f0f-e3edcb9acec6 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:36.710189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-078cf3c9-aba6-4a34-9f0f-e3edcb9acec6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:36.725183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cf3c9-aba6-4a34-9f0f-e3edcb9acec6 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:36.731641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6da60b-c8fe-4e42-94f0-ae92af3a5307 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:36.732513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6da60b-c8fe-4e42-94f0-ae92af3a5307 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:36.732836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6da60b-c8fe-4e42-94f0-ae92af3a5307 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:36.733118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6da60b-c8fe-4e42-94f0-ae92af3a5307 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:36.734948 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2b6da60b-c8fe-4e42-94f0-ae92af3a5307 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:36.747904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6da60b-c8fe-4e42-94f0-ae92af3a5307 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:36.749644 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6da60b-c8fe-4e42-94f0-ae92af3a5307 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:36.760949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1389/2793] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:28:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:28:36.775739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a186b-6782-4149-b867-5e03a994b04f service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:36.777257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-c24a186b-6782-4149-b867-5e03a994b04f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:36.789993 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a186b-6782-4149-b867-5e03a994b04f service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:36.796844 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4780687-ce72-4d07-8c40-ce781848182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:36.797725 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4780687-ce72-4d07-8c40-ce781848182c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:36.798007 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4780687-ce72-4d07-8c40-ce781848182c admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:36.798334 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4780687-ce72-4d07-8c40-ce781848182c admin admin] PATH_INFO: `/v3/users/5e2fa25be8de4b88aaad78ce0001791e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:36.799641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4780687-ce72-4d07-8c40-ce781848182c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2fa25be8de4b88aaad78ce0001791e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:36.801783 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4780687-ce72-4d07-8c40-ce781848182c admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:36.847550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d4780687-ce72-4d07-8c40-ce781848182c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2fa25be8de4b88aaad78ce0001791e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:36.854324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d4780687-ce72-4d07-8c40-ce781848182c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2fa25be8de4b88aaad78ce0001791e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:36.854990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d4780687-ce72-4d07-8c40-ce781848182c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2fa25be8de4b88aaad78ce0001791e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:36.856377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d4780687-ce72-4d07-8c40-ce781848182c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2fa25be8de4b88aaad78ce0001791e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:36.868042 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-d4780687-ce72-4d07-8c40-ce781848182c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2fa25be8de4b88aaad78ce0001791e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:36.882561 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1405/2794] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:28:36 2022] DELETE /identity/v3/users/5e2fa25be8de4b88aaad78ce0001791e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:37.058303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6da60b-c8fe-4e42-94f0-ae92af3a5307 service placement] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:37.071319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6da60b-c8fe-4e42-94f0-ae92af3a5307 service placement] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:37.128564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:37.129456 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.129747 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.130029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] PATH_INFO: `/v3/projects/596a2cdd1323457c9a53fc7a4384262e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.131212 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=596a2cdd1323457c9a53fc7a4384262e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:37.133156 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:37.178619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596a2cdd1323457c9a53fc7a4384262e', 'request_id': 'req-1be874ff-07db-489a-a83a-ee25472a53bc'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:37.184709 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596a2cdd1323457c9a53fc7a4384262e', 'request_id': 'req-1be874ff-07db-489a-a83a-ee25472a53bc'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:37.190149 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596a2cdd1323457c9a53fc7a4384262e', 'request_id': 'req-1be874ff-07db-489a-a83a-ee25472a53bc'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:37.201760 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] The token cache is being invalidate because project 596a2cdd1323457c9a53fc7a4384262e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:28:37.202050 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:37.202692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1be874ff-07db-489a-a83a-ee25472a53bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:37.204208 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1390/2795] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:28:37 2022] DELETE /identity/v3/projects/596a2cdd1323457c9a53fc7a4384262e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:37.209203 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efece3-03c0-40be-83bf-cb611ccf4c55 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.209497 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efece3-03c0-40be-83bf-cb611ccf4c55 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.209778 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efece3-03c0-40be-83bf-cb611ccf4c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.263983 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:37.267202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f3efece3-03c0-40be-83bf-cb611ccf4c55 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:37.268825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f3efece3-03c0-40be-83bf-cb611ccf4c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:37.327532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1406/2796] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:37.335817 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9ae6a-5c5e-4e98-8e19-718ce753562e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.336106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9ae6a-5c5e-4e98-8e19-718ce753562e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.336417 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9ae6a-5c5e-4e98-8e19-718ce753562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.354838 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d6a9ae6a-5c5e-4e98-8e19-718ce753562e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:37.356731 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d6a9ae6a-5c5e-4e98-8e19-718ce753562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:37.364428 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1391/2797] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:37.368449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efece3-03c0-40be-83bf-cb611ccf4c55 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:37.378222 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efece3-03c0-40be-83bf-cb611ccf4c55 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:37.382789 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050cea2-1e7a-43e7-8fd8-b0f75afde977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:37.383430 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050cea2-1e7a-43e7-8fd8-b0f75afde977 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.383714 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050cea2-1e7a-43e7-8fd8-b0f75afde977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.383987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050cea2-1e7a-43e7-8fd8-b0f75afde977 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.384739 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050cea2-1e7a-43e7-8fd8-b0f75afde977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:28:37.385048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050cea2-1e7a-43e7-8fd8-b0f75afde977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:37.386730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050cea2-1e7a-43e7-8fd8-b0f75afde977 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:37.398142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1407/2798] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:28:37.402099 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9ae6a-5c5e-4e98-8e19-718ce753562e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:37.411669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9ae6a-5c5e-4e98-8e19-718ce753562e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:37.416250 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b182f-776a-414d-b524-9a2682338480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:37.417183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b182f-776a-414d-b524-9a2682338480 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.417469 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b182f-776a-414d-b524-9a2682338480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.417744 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b182f-776a-414d-b524-9a2682338480 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.419115 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b182f-776a-414d-b524-9a2682338480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:37.421043 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b182f-776a-414d-b524-9a2682338480 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:37.446264 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1392/2799] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:28:37 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:28:37.450394 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050cea2-1e7a-43e7-8fd8-b0f75afde977 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:37.460244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050cea2-1e7a-43e7-8fd8-b0f75afde977 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:37.515071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e30e9-2695-40c7-baa4-f97b39702a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:37.515732 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e30e9-2695-40c7-baa4-f97b39702a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.516022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e30e9-2695-40c7-baa4-f97b39702a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.516322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e30e9-2695-40c7-baa4-f97b39702a1f admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.517104 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e30e9-2695-40c7-baa4-f97b39702a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:37.519016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e30e9-2695-40c7-baa4-f97b39702a1f admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:37.538922 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1408/2800] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:28:37 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:28:37.543390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b182f-776a-414d-b524-9a2682338480 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:37.553513 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b182f-776a-414d-b524-9a2682338480 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:37.558140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d5f43-458e-49cc-af68-c380b743c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:37.558844 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d5f43-458e-49cc-af68-c380b743c29c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.559128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d5f43-458e-49cc-af68-c380b743c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.559406 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d5f43-458e-49cc-af68-c380b743c29c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.560132 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d5f43-458e-49cc-af68-c380b743c29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:37.561774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d5f43-458e-49cc-af68-c380b743c29c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:37.572094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1393/2801] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:28:37.576338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e30e9-2695-40c7-baa4-f97b39702a1f admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:37.586306 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e30e9-2695-40c7-baa4-f97b39702a1f admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:37.591618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baff827-1b9b-4bd8-8ad7-ba22edc2c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:37.592277 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baff827-1b9b-4bd8-8ad7-ba22edc2c5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.592568 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baff827-1b9b-4bd8-8ad7-ba22edc2c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.592889 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baff827-1b9b-4bd8-8ad7-ba22edc2c5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.593625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baff827-1b9b-4bd8-8ad7-ba22edc2c5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:37.595244 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baff827-1b9b-4bd8-8ad7-ba22edc2c5c7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:37.605115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1409/2802] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:28:37.609074 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d5f43-458e-49cc-af68-c380b743c29c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:37.618802 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d5f43-458e-49cc-af68-c380b743c29c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:37.623779 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c7ca7-7411-47d8-8cc3-ee916054b36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:37.624690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c7ca7-7411-47d8-8cc3-ee916054b36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.625076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c7ca7-7411-47d8-8cc3-ee916054b36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.625253 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c7ca7-7411-47d8-8cc3-ee916054b36b admin admin] PATH_INFO: `/v3/projects/edf92424f063426aab40123ae975ae8e/users/390d34e509514a9ea2a296b54286c485/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.640582 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c7ca7-7411-47d8-8cc3-ee916054b36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf92424f063426aab40123ae975ae8e, user_id=390d34e509514a9ea2a296b54286c485, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:37.643300 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c7ca7-7411-47d8-8cc3-ee916054b36b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:37.656415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1394/2803] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:28:37 2022] PUT /identity/v3/projects/edf92424f063426aab40123ae975ae8e/users/390d34e509514a9ea2a296b54286c485/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:37.666262 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22e1e-8883-4374-acee-ed598ee1a397 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.666822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22e1e-8883-4374-acee-ed598ee1a397 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.667106 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22e1e-8883-4374-acee-ed598ee1a397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.693313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f2f22e1e-8883-4374-acee-ed598ee1a397 None None] MFA Rules not processed for user `390d34e509514a9ea2a296b54286c485`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:37.694525 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f2f22e1e-8883-4374-acee-ed598ee1a397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:37.759333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1410/2804] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:37.764437 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c7ca7-7411-47d8-8cc3-ee916054b36b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:37.778361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:37.828758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c7ca7-7411-47d8-8cc3-ee916054b36b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:37.833445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa9044-17f0-4bf2-9d53-cf068af15cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:37.834101 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa9044-17f0-4bf2-9d53-cf068af15cda admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.834390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa9044-17f0-4bf2-9d53-cf068af15cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.834673 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa9044-17f0-4bf2-9d53-cf068af15cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.835356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa9044-17f0-4bf2-9d53-cf068af15cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:37.837405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa9044-17f0-4bf2-9d53-cf068af15cda admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:37.862003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1395/2805] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:28:37 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:28:37.866183 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f22e1e-8883-4374-acee-ed598ee1a397 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:37.872182 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:37.879115 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f22e1e-8883-4374-acee-ed598ee1a397 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:37.935984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83110e1-f4ae-4a37-822b-d6e0434c784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:37.936682 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83110e1-f4ae-4a37-822b-d6e0434c784a admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.936970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83110e1-f4ae-4a37-822b-d6e0434c784a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.937260 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83110e1-f4ae-4a37-822b-d6e0434c784a admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.937934 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83110e1-f4ae-4a37-822b-d6e0434c784a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:37.939870 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83110e1-f4ae-4a37-822b-d6e0434c784a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:37.959966 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1411/2806] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:28:37 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:28:37.963949 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa9044-17f0-4bf2-9d53-cf068af15cda admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:37.974203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa9044-17f0-4bf2-9d53-cf068af15cda admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:37.978868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386857-becb-4ae6-a77b-8ae3a97d8c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:37.979524 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386857-becb-4ae6-a77b-8ae3a97d8c2e admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:37.979814 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386857-becb-4ae6-a77b-8ae3a97d8c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:37.980094 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386857-becb-4ae6-a77b-8ae3a97d8c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:37.980907 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75386857-becb-4ae6-a77b-8ae3a97d8c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:37.982555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75386857-becb-4ae6-a77b-8ae3a97d8c2e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:37.993104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1396/2807] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:28:37.998162 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83110e1-f4ae-4a37-822b-d6e0434c784a admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:38.007902 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83110e1-f4ae-4a37-822b-d6e0434c784a admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:38.013453 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214d00-ebd0-4c1f-88bb-448b454d0222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:38.014409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214d00-ebd0-4c1f-88bb-448b454d0222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:38.014820 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214d00-ebd0-4c1f-88bb-448b454d0222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:38.015470 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214d00-ebd0-4c1f-88bb-448b454d0222 admin admin] PATH_INFO: `/v3/projects/3c89843fb9024e2396a36f1ae2adb7bd/users/50c5d08760df4c7f86bd762c89dde99b/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:38.030387 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31214d00-ebd0-4c1f-88bb-448b454d0222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c89843fb9024e2396a36f1ae2adb7bd, user_id=50c5d08760df4c7f86bd762c89dde99b, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:38.033047 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31214d00-ebd0-4c1f-88bb-448b454d0222 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:38.046710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1412/2808] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:28:37 2022] PUT /identity/v3/projects/3c89843fb9024e2396a36f1ae2adb7bd/users/50c5d08760df4c7f86bd762c89dde99b/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:38.050723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386857-becb-4ae6-a77b-8ae3a97d8c2e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:38.061045 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386857-becb-4ae6-a77b-8ae3a97d8c2e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:38.116001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbc049-34df-4a21-a054-ab3b2b48ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:38.116693 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbc049-34df-4a21-a054-ab3b2b48ee87 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:38.116914 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbc049-34df-4a21-a054-ab3b2b48ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:38.117190 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbc049-34df-4a21-a054-ab3b2b48ee87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:38.117912 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbc049-34df-4a21-a054-ab3b2b48ee87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:38.119517 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbc049-34df-4a21-a054-ab3b2b48ee87 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:38.129913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1397/2809] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:28:38.133980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214d00-ebd0-4c1f-88bb-448b454d0222 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:38.145335 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214d00-ebd0-4c1f-88bb-448b454d0222 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:38.149947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404d108-9476-47db-84f4-7dab59324ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:38.150815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404d108-9476-47db-84f4-7dab59324ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:38.151095 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404d108-9476-47db-84f4-7dab59324ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:38.151367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404d108-9476-47db-84f4-7dab59324ebd admin admin] PATH_INFO: `/v3/projects/3c89843fb9024e2396a36f1ae2adb7bd/users/50c5d08760df4c7f86bd762c89dde99b/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:38.153863 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404d108-9476-47db-84f4-7dab59324ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c89843fb9024e2396a36f1ae2adb7bd, user_id=50c5d08760df4c7f86bd762c89dde99b, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:38.156481 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404d108-9476-47db-84f4-7dab59324ebd admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:38.166753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1413/2810] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:28:38 2022] PUT /identity/v3/projects/3c89843fb9024e2396a36f1ae2adb7bd/users/50c5d08760df4c7f86bd762c89dde99b/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:38.177541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e87742-0146-418b-b8a7-46440d7e2d87 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:38.177833 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e87742-0146-418b-b8a7-46440d7e2d87 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:38.178118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e87742-0146-418b-b8a7-46440d7e2d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:38.206730 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-61e87742-0146-418b-b8a7-46440d7e2d87 None None] MFA Rules not processed for user `50c5d08760df4c7f86bd762c89dde99b`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:38.207940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-61e87742-0146-418b-b8a7-46440d7e2d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:38.275724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1398/2811] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:38.286313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404d108-9476-47db-84f4-7dab59324ebd admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:38.288018 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-0404d108-9476-47db-84f4-7dab59324ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:38.368108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404d108-9476-47db-84f4-7dab59324ebd admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:38.372472 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafed8b-5048-4daf-95fb-817b007ede8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:38.373144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafed8b-5048-4daf-95fb-817b007ede8b service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:38.373431 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafed8b-5048-4daf-95fb-817b007ede8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:38.373710 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafed8b-5048-4daf-95fb-817b007ede8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:38.419205 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:38.429767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafed8b-5048-4daf-95fb-817b007ede8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:38.431207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafed8b-5048-4daf-95fb-817b007ede8b service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:38.440658 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1414/2812] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:28:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:28:40.973805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e87742-0146-418b-b8a7-46440d7e2d87 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:40.983718 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e87742-0146-418b-b8a7-46440d7e2d87 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:40.987223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe24bdb-5f11-41a7-96ae-b8d18c28be44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:40.987854 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe24bdb-5f11-41a7-96ae-b8d18c28be44 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:40.988137 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe24bdb-5f11-41a7-96ae-b8d18c28be44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:40.988408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe24bdb-5f11-41a7-96ae-b8d18c28be44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:40.995108 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:40.998534 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe24bdb-5f11-41a7-96ae-b8d18c28be44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:41.000262 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe24bdb-5f11-41a7-96ae-b8d18c28be44 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:41.010581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1399/2813] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:28:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:28:48.436487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=5 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:51.007153 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:53.487834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafed8b-5048-4daf-95fb-817b007ede8b service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:53.550821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafed8b-5048-4daf-95fb-817b007ede8b service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:53.555356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:53.556220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:53.556505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:53.556812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] PATH_INFO: `/v3/users/390d34e509514a9ea2a296b54286c485` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:53.558626 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=390d34e509514a9ea2a296b54286c485)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:53.560677 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:53.606912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390d34e509514a9ea2a296b54286c485'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:53.613774 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390d34e509514a9ea2a296b54286c485'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:53.614439 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390d34e509514a9ea2a296b54286c485'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:53.615059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390d34e509514a9ea2a296b54286c485'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:53.627885 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390d34e509514a9ea2a296b54286c485'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:53.641826 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1415/2814] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:28:53 2022] DELETE /identity/v3/users/390d34e509514a9ea2a296b54286c485 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:53.646234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb6c40-5f1b-4945-80ef-da3978b1b570 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:53.646692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb6c40-5f1b-4945-80ef-da3978b1b570 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:53.646821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb6c40-5f1b-4945-80ef-da3978b1b570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:53.664890 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f9cb6c40-5f1b-4945-80ef-da3978b1b570 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:53.666073 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f9cb6c40-5f1b-4945-80ef-da3978b1b570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:53.725048 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1400/2815] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:53.735444 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:53.736888 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:53.793298 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dfc93-3c20-494a-9cbe-d1c338c7ead7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:53.796987 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f22def-2ce9-44ec-80cd-ac5799ef6576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:53.797626 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f22def-2ce9-44ec-80cd-ac5799ef6576 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:53.797912 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f22def-2ce9-44ec-80cd-ac5799ef6576 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:53.798194 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f22def-2ce9-44ec-80cd-ac5799ef6576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:53.807170 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f22def-2ce9-44ec-80cd-ac5799ef6576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:53.808779 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f22def-2ce9-44ec-80cd-ac5799ef6576 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:53.818125 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1416/2816] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:28:54.088869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb6c40-5f1b-4945-80ef-da3978b1b570 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:54.091579 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f9cb6c40-5f1b-4945-80ef-da3978b1b570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:54.103448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb6c40-5f1b-4945-80ef-da3978b1b570 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:54.109020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:54.109804 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:54.110121 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:54.110419 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] PATH_INFO: `/v3/projects/edf92424f063426aab40123ae975ae8e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:54.111592 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf92424f063426aab40123ae975ae8e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:54.113527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:54.161661 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf92424f063426aab40123ae975ae8e', 'request_id': 'req-3b29a80b-4640-4771-a686-44baf0ffc0a0'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.168438 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf92424f063426aab40123ae975ae8e', 'request_id': 'req-3b29a80b-4640-4771-a686-44baf0ffc0a0'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.173882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf92424f063426aab40123ae975ae8e', 'request_id': 'req-3b29a80b-4640-4771-a686-44baf0ffc0a0'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.186639 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] The token cache is being invalidate because project edf92424f063426aab40123ae975ae8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:28:54.186928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.187546 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.189105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1401/2817] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:28:54 2022] DELETE /identity/v3/projects/edf92424f063426aab40123ae975ae8e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:54.193164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f22def-2ce9-44ec-80cd-ac5799ef6576 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:54.203393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f22def-2ce9-44ec-80cd-ac5799ef6576 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:54.222111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:54.262618 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf4fa2-1b50-4c32-bb17-63c708268e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:54.263488 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf4fa2-1b50-4c32-bb17-63c708268e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:54.263825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf4fa2-1b50-4c32-bb17-63c708268e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:54.264048 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf4fa2-1b50-4c32-bb17-63c708268e1a admin admin] PATH_INFO: `/v3/users/50c5d08760df4c7f86bd762c89dde99b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:54.265256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf4fa2-1b50-4c32-bb17-63c708268e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c5d08760df4c7f86bd762c89dde99b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:54.267179 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf4fa2-1b50-4c32-bb17-63c708268e1a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:54.314108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8aaf4fa2-1b50-4c32-bb17-63c708268e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c5d08760df4c7f86bd762c89dde99b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.320842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8aaf4fa2-1b50-4c32-bb17-63c708268e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c5d08760df4c7f86bd762c89dde99b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.321491 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8aaf4fa2-1b50-4c32-bb17-63c708268e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c5d08760df4c7f86bd762c89dde99b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.322088 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8aaf4fa2-1b50-4c32-bb17-63c708268e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c5d08760df4c7f86bd762c89dde99b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.334625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8aaf4fa2-1b50-4c32-bb17-63c708268e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c5d08760df4c7f86bd762c89dde99b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.348121 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1417/2818] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:28:54 2022] DELETE /identity/v3/users/50c5d08760df4c7f86bd762c89dde99b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:54.618705 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:54.620196 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:54.639869 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29a80b-4640-4771-a686-44baf0ffc0a0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:54.696527 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:54.697418 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:54.697702 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:54.697976 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] PATH_INFO: `/v3/projects/3c89843fb9024e2396a36f1ae2adb7bd` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:54.699762 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c89843fb9024e2396a36f1ae2adb7bd)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:54.701704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:54.732226 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:54.750210 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c89843fb9024e2396a36f1ae2adb7bd', 'request_id': 'req-0b7769ea-69b1-4fc3-8160-3a13a4793389'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.756269 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c89843fb9024e2396a36f1ae2adb7bd', 'request_id': 'req-0b7769ea-69b1-4fc3-8160-3a13a4793389'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.761964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c89843fb9024e2396a36f1ae2adb7bd', 'request_id': 'req-0b7769ea-69b1-4fc3-8160-3a13a4793389'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.774000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] The token cache is being invalidate because project 3c89843fb9024e2396a36f1ae2adb7bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:28:54.774295 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.774925 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0b7769ea-69b1-4fc3-8160-3a13a4793389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:54.776460 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1402/2819] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:28:54 2022] DELETE /identity/v3/projects/3c89843fb9024e2396a36f1ae2adb7bd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:54.781585 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91ec9-6b84-41d8-971d-5a228a5a7c70 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:54.782075 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91ec9-6b84-41d8-971d-5a228a5a7c70 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:54.782178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91ec9-6b84-41d8-971d-5a228a5a7c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:54.800878 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-4be91ec9-6b84-41d8-971d-5a228a5a7c70 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:54.802019 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-4be91ec9-6b84-41d8-971d-5a228a5a7c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:54.861505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1418/2820] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:54.869307 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401cbb-a0e5-49c6-a777-0c4bba63f53e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:54.869605 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401cbb-a0e5-49c6-a777-0c4bba63f53e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:54.869882 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401cbb-a0e5-49c6-a777-0c4bba63f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:54.890223 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-12401cbb-a0e5-49c6-a777-0c4bba63f53e None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:54.891408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-12401cbb-a0e5-49c6-a777-0c4bba63f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:54.899170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1403/2821] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:54.903899 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be91ec9-6b84-41d8-971d-5a228a5a7c70 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:54.913583 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be91ec9-6b84-41d8-971d-5a228a5a7c70 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:54.919045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2b1f8-a607-40e4-92b5-46a0d606c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:54.919698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2b1f8-a607-40e4-92b5-46a0d606c341 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:54.919984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2b1f8-a607-40e4-92b5-46a0d606c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:54.920291 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2b1f8-a607-40e4-92b5-46a0d606c341 admin admin] PATH_INFO: `/v3/domains` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:54.921058 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2b1f8-a607-40e4-92b5-46a0d606c341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80271) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:28:54.921372 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2b1f8-a607-40e4-92b5-46a0d606c341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:54.922974 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2b1f8-a607-40e4-92b5-46a0d606c341 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:54.935152 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1419/2822] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:28:54.939313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12401cbb-a0e5-49c6-a777-0c4bba63f53e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:54.948442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12401cbb-a0e5-49c6-a777-0c4bba63f53e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:54.953732 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52695179-b05b-4f97-89a4-aefa475febd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:54.954375 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695179-b05b-4f97-89a4-aefa475febd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:54.954658 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695179-b05b-4f97-89a4-aefa475febd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:54.954935 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695179-b05b-4f97-89a4-aefa475febd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:54.955621 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52695179-b05b-4f97-89a4-aefa475febd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:54.957542 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52695179-b05b-4f97-89a4-aefa475febd3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:54.984370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1404/2823] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:28:54 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:28:54.987817 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2b1f8-a607-40e4-92b5-46a0d606c341 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:54.998566 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2b1f8-a607-40e4-92b5-46a0d606c341 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:55.025243 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:55.057757 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf02c5-bb8c-47cb-859a-2dd7aedabaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:55.058939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf02c5-bb8c-47cb-859a-2dd7aedabaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.059228 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf02c5-bb8c-47cb-859a-2dd7aedabaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.059510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf02c5-bb8c-47cb-859a-2dd7aedabaf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.060202 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf02c5-bb8c-47cb-859a-2dd7aedabaf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:55.062155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf02c5-bb8c-47cb-859a-2dd7aedabaf7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:55.080936 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1420/2824] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:28:54 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:28:55.085183 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52695179-b05b-4f97-89a4-aefa475febd3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:55.095897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52695179-b05b-4f97-89a4-aefa475febd3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:55.100404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b119206-d8df-4865-8cc5-e032a7736a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:55.101089 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b119206-d8df-4865-8cc5-e032a7736a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.101373 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b119206-d8df-4865-8cc5-e032a7736a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.101651 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b119206-d8df-4865-8cc5-e032a7736a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.102390 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b119206-d8df-4865-8cc5-e032a7736a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:55.103966 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b119206-d8df-4865-8cc5-e032a7736a80 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:55.115003 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1405/2825] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:28:55.118842 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf02c5-bb8c-47cb-859a-2dd7aedabaf7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:55.128814 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf02c5-bb8c-47cb-859a-2dd7aedabaf7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:55.133481 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddec02e-2bc9-4276-8633-39d58b2214e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:55.134165 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddec02e-2bc9-4276-8633-39d58b2214e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.134449 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddec02e-2bc9-4276-8633-39d58b2214e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.134748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddec02e-2bc9-4276-8633-39d58b2214e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.135461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddec02e-2bc9-4276-8633-39d58b2214e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:55.137131 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddec02e-2bc9-4276-8633-39d58b2214e8 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:55.147164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1421/2826] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:28:55.151188 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b119206-d8df-4865-8cc5-e032a7736a80 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:55.161789 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b119206-d8df-4865-8cc5-e032a7736a80 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:55.166863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478e5b6-4459-4cd1-a932-259e7cee2677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:55.168343 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478e5b6-4459-4cd1-a932-259e7cee2677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.168703 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478e5b6-4459-4cd1-a932-259e7cee2677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.169008 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478e5b6-4459-4cd1-a932-259e7cee2677 admin admin] PATH_INFO: `/v3/projects/3e308c18735d4c4e845aa4956ffabb33/users/415b9714b518492d9c7e9eb4364c379d/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.185580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478e5b6-4459-4cd1-a932-259e7cee2677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e308c18735d4c4e845aa4956ffabb33, user_id=415b9714b518492d9c7e9eb4364c379d, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:55.188230 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478e5b6-4459-4cd1-a932-259e7cee2677 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:55.201346 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1406/2827] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:28:55 2022] PUT /identity/v3/projects/3e308c18735d4c4e845aa4956ffabb33/users/415b9714b518492d9c7e9eb4364c379d/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:55.211377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1559551-a9b5-4096-a77e-9585f9a4cb1f None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.211678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1559551-a9b5-4096-a77e-9585f9a4cb1f None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.211995 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1559551-a9b5-4096-a77e-9585f9a4cb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.239093 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f1559551-a9b5-4096-a77e-9585f9a4cb1f None None] MFA Rules not processed for user `415b9714b518492d9c7e9eb4364c379d`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:55.240326 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f1559551-a9b5-4096-a77e-9585f9a4cb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:55.303423 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1422/2828] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:55.307971 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478e5b6-4459-4cd1-a932-259e7cee2677 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:55.368289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478e5b6-4459-4cd1-a932-259e7cee2677 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:55.373476 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb0e0-06a1-40af-8392-3093c5722eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:55.374122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb0e0-06a1-40af-8392-3093c5722eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.374409 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb0e0-06a1-40af-8392-3093c5722eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.374689 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb0e0-06a1-40af-8392-3093c5722eb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.375376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cb0e0-06a1-40af-8392-3093c5722eb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:55.377327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cb0e0-06a1-40af-8392-3093c5722eb4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:55.401406 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1407/2829] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:28:55 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:28:55.406281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1559551-a9b5-4096-a77e-9585f9a4cb1f None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:55.417034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1559551-a9b5-4096-a77e-9585f9a4cb1f None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:55.473868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39acf84-43c1-40ea-a372-524ed7c3d083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:55.474560 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39acf84-43c1-40ea-a372-524ed7c3d083 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.474869 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39acf84-43c1-40ea-a372-524ed7c3d083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.475155 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39acf84-43c1-40ea-a372-524ed7c3d083 admin admin] PATH_INFO: `/v3/users` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.475881 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39acf84-43c1-40ea-a372-524ed7c3d083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:55.477891 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39acf84-43c1-40ea-a372-524ed7c3d083 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:55.497843 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1423/2830] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:28:55 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:28:55.501899 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb0e0-06a1-40af-8392-3093c5722eb4 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:55.513081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb0e0-06a1-40af-8392-3093c5722eb4 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:55.517680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef6a4b-ee84-4960-b656-ac719d198be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:55.518338 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef6a4b-ee84-4960-b656-ac719d198be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.518625 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef6a4b-ee84-4960-b656-ac719d198be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.518904 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef6a4b-ee84-4960-b656-ac719d198be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.519637 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef6a4b-ee84-4960-b656-ac719d198be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:55.521290 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef6a4b-ee84-4960-b656-ac719d198be1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:55.532291 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1408/2831] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:28:55.536362 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39acf84-43c1-40ea-a372-524ed7c3d083 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:55.546569 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39acf84-43c1-40ea-a372-524ed7c3d083 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:55.551177 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8f10-ef06-455f-8fa4-104bef15d06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:55.552036 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8f10-ef06-455f-8fa4-104bef15d06b admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.552324 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8f10-ef06-455f-8fa4-104bef15d06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.552601 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8f10-ef06-455f-8fa4-104bef15d06b admin admin] PATH_INFO: `/v3/projects/c18dda960d5d438489f2de67cce12e66/users/36565adbde644fbe81ca5308eb64a378/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.567223 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d8f10-ef06-455f-8fa4-104bef15d06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18dda960d5d438489f2de67cce12e66, user_id=36565adbde644fbe81ca5308eb64a378, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:55.569892 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d8f10-ef06-455f-8fa4-104bef15d06b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:55.583002 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1424/2832] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:28:55 2022] PUT /identity/v3/projects/c18dda960d5d438489f2de67cce12e66/users/36565adbde644fbe81ca5308eb64a378/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:55.586792 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef6a4b-ee84-4960-b656-ac719d198be1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:55.597459 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef6a4b-ee84-4960-b656-ac719d198be1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:55.617270 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:55.657826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd188b-3953-4f4a-8e6a-165489e2f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:55.658493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd188b-3953-4f4a-8e6a-165489e2f9af admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.658777 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd188b-3953-4f4a-8e6a-165489e2f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.659051 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd188b-3953-4f4a-8e6a-165489e2f9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.659772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd188b-3953-4f4a-8e6a-165489e2f9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:55.661607 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd188b-3953-4f4a-8e6a-165489e2f9af admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:55.671772 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1409/2833] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:28:55.676055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8f10-ef06-455f-8fa4-104bef15d06b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:55.681452 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:55.687767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8f10-ef06-455f-8fa4-104bef15d06b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:55.692663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781989d0-ea2e-4030-9ad2-9e8b4641d363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:55.693538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781989d0-ea2e-4030-9ad2-9e8b4641d363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.693822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781989d0-ea2e-4030-9ad2-9e8b4641d363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.694096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781989d0-ea2e-4030-9ad2-9e8b4641d363 admin admin] PATH_INFO: `/v3/projects/c18dda960d5d438489f2de67cce12e66/users/36565adbde644fbe81ca5308eb64a378/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.696034 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781989d0-ea2e-4030-9ad2-9e8b4641d363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18dda960d5d438489f2de67cce12e66, user_id=36565adbde644fbe81ca5308eb64a378, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:55.699761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781989d0-ea2e-4030-9ad2-9e8b4641d363 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:55.709939 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1425/2834] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:28:55 2022] PUT /identity/v3/projects/c18dda960d5d438489f2de67cce12e66/users/36565adbde644fbe81ca5308eb64a378/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:55.722029 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36d3cf-203e-4929-805d-c73d04a33974 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.722511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36d3cf-203e-4929-805d-c73d04a33974 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.722630 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36d3cf-203e-4929-805d-c73d04a33974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.748921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-db36d3cf-203e-4929-805d-c73d04a33974 None None] MFA Rules not processed for user `36565adbde644fbe81ca5308eb64a378`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:55.750123 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-db36d3cf-203e-4929-805d-c73d04a33974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:55.822397 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1410/2835] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:55.833767 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781989d0-ea2e-4030-9ad2-9e8b4641d363 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:55.835538 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-781989d0-ea2e-4030-9ad2-9e8b4641d363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:55.893705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781989d0-ea2e-4030-9ad2-9e8b4641d363 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:55.897333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e3827-41df-4c45-813a-7999f6b97848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:55.897970 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3827-41df-4c45-813a-7999f6b97848 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:55.898258 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3827-41df-4c45-813a-7999f6b97848 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:55.898533 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3827-41df-4c45-813a-7999f6b97848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:55.907879 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e3827-41df-4c45-813a-7999f6b97848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:55.909343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e3827-41df-4c45-813a-7999f6b97848 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:55.919220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1426/2836] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:28:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:28:55.946804 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36d3cf-203e-4929-805d-c73d04a33974 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:56.007748 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36d3cf-203e-4929-805d-c73d04a33974 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:56.013357 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:56.014234 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:56.014519 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:56.014801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] PATH_INFO: `/v3/users/415b9714b518492d9c7e9eb4364c379d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:56.016002 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415b9714b518492d9c7e9eb4364c379d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:56.017940 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:56.063983 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415b9714b518492d9c7e9eb4364c379d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.065634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:56.072095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415b9714b518492d9c7e9eb4364c379d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.072895 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415b9714b518492d9c7e9eb4364c379d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.074240 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415b9714b518492d9c7e9eb4364c379d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.086081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415b9714b518492d9c7e9eb4364c379d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.098001 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1411/2837] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:28:55 2022] DELETE /identity/v3/users/415b9714b518492d9c7e9eb4364c379d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:56.102489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0efe-7a85-4abb-9b04-65d49e461c98 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:56.102785 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0efe-7a85-4abb-9b04-65d49e461c98 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:56.103070 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0efe-7a85-4abb-9b04-65d49e461c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:56.121947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-3efa0efe-7a85-4abb-9b04-65d49e461c98 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:56.123140 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3efa0efe-7a85-4abb-9b04-65d49e461c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:56.181437 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1427/2838] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:56.191618 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:56.193150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:56.250696 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94788f-aac5-4410-8e03-79d879440b67 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:56.254361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc379d8-3435-4bb8-8c1e-595a923bd988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:56.255004 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc379d8-3435-4bb8-8c1e-595a923bd988 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:56.255293 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc379d8-3435-4bb8-8c1e-595a923bd988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:56.255572 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc379d8-3435-4bb8-8c1e-595a923bd988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:56.264990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc379d8-3435-4bb8-8c1e-595a923bd988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:56.266496 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc379d8-3435-4bb8-8c1e-595a923bd988 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:56.276497 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1412/2839] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:28:56.542022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa0efe-7a85-4abb-9b04-65d49e461c98 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:56.543942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3efa0efe-7a85-4abb-9b04-65d49e461c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:56.556134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa0efe-7a85-4abb-9b04-65d49e461c98 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:56.561792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:56.562673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:56.562961 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:56.563242 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] PATH_INFO: `/v3/projects/3e308c18735d4c4e845aa4956ffabb33` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:56.564468 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e308c18735d4c4e845aa4956ffabb33)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:56.566447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:56.616347 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e308c18735d4c4e845aa4956ffabb33', 'request_id': 'req-8232c798-19ea-4a56-980f-aca26db6829e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.623255 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e308c18735d4c4e845aa4956ffabb33', 'request_id': 'req-8232c798-19ea-4a56-980f-aca26db6829e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.631393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e308c18735d4c4e845aa4956ffabb33', 'request_id': 'req-8232c798-19ea-4a56-980f-aca26db6829e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.642754 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] The token cache is being invalidate because project 3e308c18735d4c4e845aa4956ffabb33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:28:56.643054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.643660 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.645261 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1428/2840] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:28:56 2022] DELETE /identity/v3/projects/3e308c18735d4c4e845aa4956ffabb33 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:56.649362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc379d8-3435-4bb8-8c1e-595a923bd988 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:56.658966 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc379d8-3435-4bb8-8c1e-595a923bd988 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:56.714888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eb377-d7ae-4d1e-81d2-b5fd75607725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:56.715757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eb377-d7ae-4d1e-81d2-b5fd75607725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:56.716048 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eb377-d7ae-4d1e-81d2-b5fd75607725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:56.716328 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eb377-d7ae-4d1e-81d2-b5fd75607725 admin admin] PATH_INFO: `/v3/users/36565adbde644fbe81ca5308eb64a378` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:56.717545 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4eb377-d7ae-4d1e-81d2-b5fd75607725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36565adbde644fbe81ca5308eb64a378)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:56.719461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4eb377-d7ae-4d1e-81d2-b5fd75607725 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:56.765213 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc4eb377-d7ae-4d1e-81d2-b5fd75607725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36565adbde644fbe81ca5308eb64a378'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.772072 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc4eb377-d7ae-4d1e-81d2-b5fd75607725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36565adbde644fbe81ca5308eb64a378'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.772735 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc4eb377-d7ae-4d1e-81d2-b5fd75607725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36565adbde644fbe81ca5308eb64a378'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.773339 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc4eb377-d7ae-4d1e-81d2-b5fd75607725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36565adbde644fbe81ca5308eb64a378'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.784392 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:56.785564 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cc4eb377-d7ae-4d1e-81d2-b5fd75607725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36565adbde644fbe81ca5308eb64a378'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:56.800020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1413/2841] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:28:56 2022] DELETE /identity/v3/users/36565adbde644fbe81ca5308eb64a378 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:57.080729 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:57.082650 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:57.100698 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232c798-19ea-4a56-980f-aca26db6829e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:57.113602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:57.161276 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:57.162065 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.162353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.162631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] PATH_INFO: `/v3/projects/c18dda960d5d438489f2de67cce12e66` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.163811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18dda960d5d438489f2de67cce12e66)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:57.165771 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:57.211598 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18dda960d5d438489f2de67cce12e66', 'request_id': 'req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:57.218069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18dda960d5d438489f2de67cce12e66', 'request_id': 'req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:57.225695 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18dda960d5d438489f2de67cce12e66', 'request_id': 'req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:57.236791 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] The token cache is being invalidate because project c18dda960d5d438489f2de67cce12e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:28:57.237086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:57.237730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-46f06eb5-7e3b-4fae-96a6-cfbc4ea8bd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:28:57.239257 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1429/2842] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:28:57 2022] DELETE /identity/v3/projects/c18dda960d5d438489f2de67cce12e66 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:57.244897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e24d-5d21-4c17-b832-fd853d3f9144 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.245192 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e24d-5d21-4c17-b832-fd853d3f9144 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.246171 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e24d-5d21-4c17-b832-fd853d3f9144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.264424 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3970e24d-5d21-4c17-b832-fd853d3f9144 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:57.265663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3970e24d-5d21-4c17-b832-fd853d3f9144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:57.325415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1414/2843] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:28:57.333220 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b49917-15e7-4e88-a76b-9f19f66a9913 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.333540 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b49917-15e7-4e88-a76b-9f19f66a9913 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.333822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b49917-15e7-4e88-a76b-9f19f66a9913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.353639 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-e0b49917-15e7-4e88-a76b-9f19f66a9913 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:57.356063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-e0b49917-15e7-4e88-a76b-9f19f66a9913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:57.363840 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1430/2844] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:57.367963 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970e24d-5d21-4c17-b832-fd853d3f9144 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:57.377828 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970e24d-5d21-4c17-b832-fd853d3f9144 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:57.382464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8032e-188d-4308-8d90-0582d1618f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:57.383114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8032e-188d-4308-8d90-0582d1618f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.383402 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8032e-188d-4308-8d90-0582d1618f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.383684 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8032e-188d-4308-8d90-0582d1618f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.384405 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8032e-188d-4308-8d90-0582d1618f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:28:57.384758 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8032e-188d-4308-8d90-0582d1618f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:57.386378 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8032e-188d-4308-8d90-0582d1618f7d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:57.397901 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1415/2845] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:28:57.403237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b49917-15e7-4e88-a76b-9f19f66a9913 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:57.412519 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b49917-15e7-4e88-a76b-9f19f66a9913 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:57.418600 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341fe59-c593-4af1-8d20-3a184beadd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:57.419240 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341fe59-c593-4af1-8d20-3a184beadd6e admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.419523 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341fe59-c593-4af1-8d20-3a184beadd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.419795 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341fe59-c593-4af1-8d20-3a184beadd6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.420485 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341fe59-c593-4af1-8d20-3a184beadd6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:57.422409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341fe59-c593-4af1-8d20-3a184beadd6e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:57.448267 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1431/2846] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:28:57 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:28:57.452559 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8032e-188d-4308-8d90-0582d1618f7d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:57.462586 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8032e-188d-4308-8d90-0582d1618f7d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:57.519311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69e35d-dd24-449f-aa41-0559447d45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:57.519985 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69e35d-dd24-449f-aa41-0559447d45d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.520270 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69e35d-dd24-449f-aa41-0559447d45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.520548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69e35d-dd24-449f-aa41-0559447d45d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.521268 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69e35d-dd24-449f-aa41-0559447d45d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:57.523170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69e35d-dd24-449f-aa41-0559447d45d7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:57.542917 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1416/2847] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:28:57 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:28:57.547366 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341fe59-c593-4af1-8d20-3a184beadd6e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:57.557696 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341fe59-c593-4af1-8d20-3a184beadd6e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:57.562532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83ff04-449c-4a76-a727-dc512062dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:57.563188 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ff04-449c-4a76-a727-dc512062dfdb admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.563478 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ff04-449c-4a76-a727-dc512062dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.563760 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ff04-449c-4a76-a727-dc512062dfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.564487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83ff04-449c-4a76-a727-dc512062dfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:57.566178 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83ff04-449c-4a76-a727-dc512062dfdb admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:57.576963 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1432/2848] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:28:57.580694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69e35d-dd24-449f-aa41-0559447d45d7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:57.591175 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69e35d-dd24-449f-aa41-0559447d45d7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:57.595757 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffee07-4acb-450f-8a18-3bac8c134ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:57.596403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffee07-4acb-450f-8a18-3bac8c134ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.596719 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffee07-4acb-450f-8a18-3bac8c134ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.597000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffee07-4acb-450f-8a18-3bac8c134ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.597721 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffee07-4acb-450f-8a18-3bac8c134ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:57.599304 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffee07-4acb-450f-8a18-3bac8c134ed6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:57.610395 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1417/2849] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:28:57.614297 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83ff04-449c-4a76-a727-dc512062dfdb admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:57.625102 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83ff04-449c-4a76-a727-dc512062dfdb admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:57.629250 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e4a26-762c-4507-8ffd-f7c04268b6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:57.630133 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e4a26-762c-4507-8ffd-f7c04268b6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.630419 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e4a26-762c-4507-8ffd-f7c04268b6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.630702 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e4a26-762c-4507-8ffd-f7c04268b6ea admin admin] PATH_INFO: `/v3/projects/9aae9849de2244b8b58181e770640f47/users/7afb91b0ce2844f99340085f76d94a4d/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.645327 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e4a26-762c-4507-8ffd-f7c04268b6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aae9849de2244b8b58181e770640f47, user_id=7afb91b0ce2844f99340085f76d94a4d, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:57.647984 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e4a26-762c-4507-8ffd-f7c04268b6ea admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:57.661537 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1433/2850] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:28:57 2022] PUT /identity/v3/projects/9aae9849de2244b8b58181e770640f47/users/7afb91b0ce2844f99340085f76d94a4d/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:57.672805 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60252-9345-4bc4-8757-8c9a6079ce4e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.673042 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60252-9345-4bc4-8757-8c9a6079ce4e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.673327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60252-9345-4bc4-8757-8c9a6079ce4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.699448 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c7d60252-9345-4bc4-8757-8c9a6079ce4e None None] MFA Rules not processed for user `7afb91b0ce2844f99340085f76d94a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:57.700725 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c7d60252-9345-4bc4-8757-8c9a6079ce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:57.742154 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:57.766875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1418/2851] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:57.771336 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e4a26-762c-4507-8ffd-f7c04268b6ea admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:57.816328 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:57.835856 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e4a26-762c-4507-8ffd-f7c04268b6ea admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:57.841290 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bf13e-0e8f-4e4a-bb06-13acc4a56840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:57.841947 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bf13e-0e8f-4e4a-bb06-13acc4a56840 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.842237 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bf13e-0e8f-4e4a-bb06-13acc4a56840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.842520 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bf13e-0e8f-4e4a-bb06-13acc4a56840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.843207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bf13e-0e8f-4e4a-bb06-13acc4a56840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:57.845164 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bf13e-0e8f-4e4a-bb06-13acc4a56840 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:57.869933 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1434/2852] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:28:57 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:28:57.874150 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d60252-9345-4bc4-8757-8c9a6079ce4e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:57.884791 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d60252-9345-4bc4-8757-8c9a6079ce4e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:57.940261 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda6c2a-20d6-4cac-a65b-409b4f0260aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:57.941028 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda6c2a-20d6-4cac-a65b-409b4f0260aa admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.941319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda6c2a-20d6-4cac-a65b-409b4f0260aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.941599 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda6c2a-20d6-4cac-a65b-409b4f0260aa admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.942289 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda6c2a-20d6-4cac-a65b-409b4f0260aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:57.944238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda6c2a-20d6-4cac-a65b-409b4f0260aa admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:57.965465 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1419/2853] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:28:57 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:28:57.969489 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bf13e-0e8f-4e4a-bb06-13acc4a56840 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:57.979695 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bf13e-0e8f-4e4a-bb06-13acc4a56840 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:57.984896 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ef2ea-1f03-411a-83a6-6cdec17aa2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:57.985553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ef2ea-1f03-411a-83a6-6cdec17aa2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:57.985834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ef2ea-1f03-411a-83a6-6cdec17aa2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:57.986107 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ef2ea-1f03-411a-83a6-6cdec17aa2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:57.986828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ef2ea-1f03-411a-83a6-6cdec17aa2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:57.988424 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ef2ea-1f03-411a-83a6-6cdec17aa2f3 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:57.999367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1435/2854] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:28:58.003362 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda6c2a-20d6-4cac-a65b-409b4f0260aa admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:58.013829 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda6c2a-20d6-4cac-a65b-409b4f0260aa admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:58.018541 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632445c-ba1c-4277-8868-b212408b9895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:58.019416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632445c-ba1c-4277-8868-b212408b9895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:58.019706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632445c-ba1c-4277-8868-b212408b9895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:58.019989 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632445c-ba1c-4277-8868-b212408b9895 admin admin] PATH_INFO: `/v3/projects/32c88994b16346bc86212ba863c231e5/users/273b9d22490c4ec78d00116bae13c043/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:58.035133 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632445c-ba1c-4277-8868-b212408b9895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c88994b16346bc86212ba863c231e5, user_id=273b9d22490c4ec78d00116bae13c043, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:58.037850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632445c-ba1c-4277-8868-b212408b9895 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:58.051421 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1420/2855] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:28:58 2022] PUT /identity/v3/projects/32c88994b16346bc86212ba863c231e5/users/273b9d22490c4ec78d00116bae13c043/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:28:58.055401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ef2ea-1f03-411a-83a6-6cdec17aa2f3 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:58.065818 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ef2ea-1f03-411a-83a6-6cdec17aa2f3 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:58.122717 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2caee-c9fd-415b-948f-139302a2c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:58.123377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2caee-c9fd-415b-948f-139302a2c98a admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:58.123665 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2caee-c9fd-415b-948f-139302a2c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:58.123941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2caee-c9fd-415b-948f-139302a2c98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:58.124690 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2caee-c9fd-415b-948f-139302a2c98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:58.126292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2caee-c9fd-415b-948f-139302a2c98a admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:58.137209 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1436/2856] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:28:58.141416 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632445c-ba1c-4277-8868-b212408b9895 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:58.152169 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632445c-ba1c-4277-8868-b212408b9895 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:58.157142 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4fcd2-a212-44c2-83a5-1cf778873204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:58.158018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4fcd2-a212-44c2-83a5-1cf778873204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:58.158308 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4fcd2-a212-44c2-83a5-1cf778873204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:58.158590 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4fcd2-a212-44c2-83a5-1cf778873204 admin admin] PATH_INFO: `/v3/projects/32c88994b16346bc86212ba863c231e5/users/273b9d22490c4ec78d00116bae13c043/roles/efc16976111d431c9173186cbd0e6c24` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:58.160571 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4fcd2-a212-44c2-83a5-1cf778873204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c88994b16346bc86212ba863c231e5, user_id=273b9d22490c4ec78d00116bae13c043, role_id=efc16976111d431c9173186cbd0e6c24)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:58.163278 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4fcd2-a212-44c2-83a5-1cf778873204 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:58.173634 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1421/2857] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:28:58 2022] PUT /identity/v3/projects/32c88994b16346bc86212ba863c231e5/users/273b9d22490c4ec78d00116bae13c043/roles/efc16976111d431c9173186cbd0e6c24 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:28:58.185558 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adc996-8e40-4d4f-b684-15ad270b26fa None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:58.185852 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adc996-8e40-4d4f-b684-15ad270b26fa None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:58.186134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adc996-8e40-4d4f-b684-15ad270b26fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:58.212575 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-34adc996-8e40-4d4f-b684-15ad270b26fa None None] MFA Rules not processed for user `273b9d22490c4ec78d00116bae13c043`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:28:58.213723 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-34adc996-8e40-4d4f-b684-15ad270b26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:58.281816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1437/2858] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:28:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:28:58.292822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4fcd2-a212-44c2-83a5-1cf778873204 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:58.294550 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-17d4fcd2-a212-44c2-83a5-1cf778873204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:58.352334 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4fcd2-a212-44c2-83a5-1cf778873204 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:58.356020 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f316b-3262-4a9d-9410-9bbe65188581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:58.356686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f316b-3262-4a9d-9410-9bbe65188581 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:58.356978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f316b-3262-4a9d-9410-9bbe65188581 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:58.357260 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f316b-3262-4a9d-9410-9bbe65188581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:58.366151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f316b-3262-4a9d-9410-9bbe65188581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:58.367577 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f316b-3262-4a9d-9410-9bbe65188581 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:58.377598 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1422/2859] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:28:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:28:58.422663 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adc996-8e40-4d4f-b684-15ad270b26fa None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:28:58.424085 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-34adc996-8e40-4d4f-b684-15ad270b26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:28:58.436792 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adc996-8e40-4d4f-b684-15ad270b26fa None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:28:58.440401 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7818e8d-d23c-44fe-be81-544ea1abf2e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:28:58.441109 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7818e8d-d23c-44fe-be81-544ea1abf2e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:28:58.441397 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7818e8d-d23c-44fe-be81-544ea1abf2e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:28:58.441672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7818e8d-d23c-44fe-be81-544ea1abf2e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:28:58.475678 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:28:58.500549 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7818e8d-d23c-44fe-be81-544ea1abf2e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:28:58.502033 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7818e8d-d23c-44fe-be81-544ea1abf2e7 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:28:58.511421 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1438/2860] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:28:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:29:01.756501 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f316b-3262-4a9d-9410-9bbe65188581 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:01.798589 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:01.820942 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f316b-3262-4a9d-9410-9bbe65188581 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:01.826538 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:01.827401 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:01.827686 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:01.827958 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] PATH_INFO: `/v3/users/7afb91b0ce2844f99340085f76d94a4d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:01.829158 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7afb91b0ce2844f99340085f76d94a4d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:01.831059 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:01.876256 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7afb91b0ce2844f99340085f76d94a4d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:01.884361 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7afb91b0ce2844f99340085f76d94a4d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:01.885000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7afb91b0ce2844f99340085f76d94a4d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:01.885598 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7afb91b0ce2844f99340085f76d94a4d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:01.898259 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7afb91b0ce2844f99340085f76d94a4d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:01.910667 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1423/2861] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:29:01 2022] DELETE /identity/v3/users/7afb91b0ce2844f99340085f76d94a4d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:29:01.915101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086cc86-597d-463d-a82b-ecb75a35cdf2 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:01.915605 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086cc86-597d-463d-a82b-ecb75a35cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:01.915711 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086cc86-597d-463d-a82b-ecb75a35cdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:01.933498 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-9086cc86-597d-463d-a82b-ecb75a35cdf2 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:29:01.934853 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9086cc86-597d-463d-a82b-ecb75a35cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:01.993615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1439/2862] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:29:02.004355 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:02.005818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:02.062967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c2ffa-f152-4b2d-890c-fb84653ede3e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:02.066675 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cbb19-9755-487f-bfa8-b61976e942f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:02.067316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cbb19-9755-487f-bfa8-b61976e942f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:02.067601 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cbb19-9755-487f-bfa8-b61976e942f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:02.067877 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cbb19-9755-487f-bfa8-b61976e942f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:02.076799 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cbb19-9755-487f-bfa8-b61976e942f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:02.078238 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cbb19-9755-487f-bfa8-b61976e942f7 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:02.087778 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1424/2863] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:29:02.361838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086cc86-597d-463d-a82b-ecb75a35cdf2 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:02.363271 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-9086cc86-597d-463d-a82b-ecb75a35cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:02.375185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086cc86-597d-463d-a82b-ecb75a35cdf2 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:02.380149 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:02.381059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:02.381414 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:02.381687 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] PATH_INFO: `/v3/projects/9aae9849de2244b8b58181e770640f47` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:02.382858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aae9849de2244b8b58181e770640f47)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:02.384858 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:02.437409 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aae9849de2244b8b58181e770640f47', 'request_id': 'req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:02.443730 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aae9849de2244b8b58181e770640f47', 'request_id': 'req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:02.451985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aae9849de2244b8b58181e770640f47', 'request_id': 'req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:02.462486 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] The token cache is being invalidate because project 9aae9849de2244b8b58181e770640f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:29:02.462822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:02.463443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:02.466148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1440/2864] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:29:02 2022] DELETE /identity/v3/projects/9aae9849de2244b8b58181e770640f47 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:29:02.470211 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cbb19-9755-487f-bfa8-b61976e942f7 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:02.480215 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cbb19-9755-487f-bfa8-b61976e942f7 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:02.537543 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acdfaa-ce07-4d2d-a76c-fb930547cfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:02.538407 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acdfaa-ce07-4d2d-a76c-fb930547cfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:02.538694 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acdfaa-ce07-4d2d-a76c-fb930547cfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:02.538970 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acdfaa-ce07-4d2d-a76c-fb930547cfdd admin admin] PATH_INFO: `/v3/users/273b9d22490c4ec78d00116bae13c043` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:02.540128 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acdfaa-ce07-4d2d-a76c-fb930547cfdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=273b9d22490c4ec78d00116bae13c043)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:02.542921 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acdfaa-ce07-4d2d-a76c-fb930547cfdd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:02.544446 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:02.590500 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-20acdfaa-ce07-4d2d-a76c-fb930547cfdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '273b9d22490c4ec78d00116bae13c043'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:02.597464 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-20acdfaa-ce07-4d2d-a76c-fb930547cfdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '273b9d22490c4ec78d00116bae13c043'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:02.598453 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-20acdfaa-ce07-4d2d-a76c-fb930547cfdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '273b9d22490c4ec78d00116bae13c043'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:02.599075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-20acdfaa-ce07-4d2d-a76c-fb930547cfdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '273b9d22490c4ec78d00116bae13c043'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:02.611461 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-20acdfaa-ce07-4d2d-a76c-fb930547cfdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '273b9d22490c4ec78d00116bae13c043'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:02.624112 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1425/2865] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:29:02 2022] DELETE /identity/v3/users/273b9d22490c4ec78d00116bae13c043 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:29:02.897672 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:02.899356 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:02.912915 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0a9ef-12d4-47d6-a051-e3685c43c96e admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:02.974072 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:02.974930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:02.975214 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:02.975487 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] PATH_INFO: `/v3/projects/32c88994b16346bc86212ba863c231e5` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:02.976684 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c88994b16346bc86212ba863c231e5)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:02.978599 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:02.981059 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:03.028029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c88994b16346bc86212ba863c231e5', 'request_id': 'req-51c74c3f-de89-42d7-bf42-adbfc2369dcc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:03.034020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c88994b16346bc86212ba863c231e5', 'request_id': 'req-51c74c3f-de89-42d7-bf42-adbfc2369dcc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:03.041924 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c88994b16346bc86212ba863c231e5', 'request_id': 'req-51c74c3f-de89-42d7-bf42-adbfc2369dcc'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:03.053448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] The token cache is being invalidate because project 32c88994b16346bc86212ba863c231e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:29:03.053715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:03.054338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-51c74c3f-de89-42d7-bf42-adbfc2369dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:03.055990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1441/2866] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:29:02 2022] DELETE /identity/v3/projects/32c88994b16346bc86212ba863c231e5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:29:03.061400 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfc609-35b4-470b-94a7-db9279b053e3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:03.061884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfc609-35b4-470b-94a7-db9279b053e3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:03.061995 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfc609-35b4-470b-94a7-db9279b053e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:03.079241 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b1bfc609-35b4-470b-94a7-db9279b053e3 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:29:03.080436 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b1bfc609-35b4-470b-94a7-db9279b053e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:03.140771 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1426/2867] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:29:03.148380 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eee02-f034-4073-ad18-16583ee85f3d None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:03.148697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eee02-f034-4073-ad18-16583ee85f3d None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:03.148980 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eee02-f034-4073-ad18-16583ee85f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:03.168493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-ed3eee02-f034-4073-ad18-16583ee85f3d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:29:03.169770 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-ed3eee02-f034-4073-ad18-16583ee85f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:03.177594 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1442/2868] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:29:03.181868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfc609-35b4-470b-94a7-db9279b053e3 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:03.191558 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfc609-35b4-470b-94a7-db9279b053e3 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:03.196138 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a2a68-94fe-42c2-923b-c7cebc4ed2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:03.196826 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a2a68-94fe-42c2-923b-c7cebc4ed2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:03.197114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a2a68-94fe-42c2-923b-c7cebc4ed2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:03.197391 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a2a68-94fe-42c2-923b-c7cebc4ed2a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:03.198124 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a2a68-94fe-42c2-923b-c7cebc4ed2a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:29:03.198946 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a2a68-94fe-42c2-923b-c7cebc4ed2a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:03.200552 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a2a68-94fe-42c2-923b-c7cebc4ed2a5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:03.211850 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1427/2869] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:29:03.216563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eee02-f034-4073-ad18-16583ee85f3d None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:03.225685 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eee02-f034-4073-ad18-16583ee85f3d None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:03.230367 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26b738-aa35-460d-82ae-3747c44930e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:03.231009 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26b738-aa35-460d-82ae-3747c44930e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:03.231292 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26b738-aa35-460d-82ae-3747c44930e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:03.231570 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26b738-aa35-460d-82ae-3747c44930e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:03.232288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26b738-aa35-460d-82ae-3747c44930e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:03.234246 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26b738-aa35-460d-82ae-3747c44930e7 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:03.259219 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1443/2870] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:29:03 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:29:03.263836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a2a68-94fe-42c2-923b-c7cebc4ed2a5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:03.273704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a2a68-94fe-42c2-923b-c7cebc4ed2a5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:03.328918 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5aae1-39aa-4dd7-955f-ac94c1b53ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:03.329574 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5aae1-39aa-4dd7-955f-ac94c1b53ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:03.329863 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5aae1-39aa-4dd7-955f-ac94c1b53ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:03.330143 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5aae1-39aa-4dd7-955f-ac94c1b53ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:03.330819 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5aae1-39aa-4dd7-955f-ac94c1b53ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:03.332729 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5aae1-39aa-4dd7-955f-ac94c1b53ff9 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:03.342956 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:03.355376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1428/2871] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:29:03 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:29:03.359124 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26b738-aa35-460d-82ae-3747c44930e7 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:03.369350 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26b738-aa35-460d-82ae-3747c44930e7 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:03.374615 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908eb92-8a3e-43e6-8033-802fb2d0834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:03.375278 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908eb92-8a3e-43e6-8033-802fb2d0834b admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:03.375563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908eb92-8a3e-43e6-8033-802fb2d0834b admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:03.375839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908eb92-8a3e-43e6-8033-802fb2d0834b admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:03.376570 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908eb92-8a3e-43e6-8033-802fb2d0834b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:03.378196 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908eb92-8a3e-43e6-8033-802fb2d0834b admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:03.389098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1444/2872] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:29:03.392941 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5aae1-39aa-4dd7-955f-ac94c1b53ff9 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:03.403408 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5aae1-39aa-4dd7-955f-ac94c1b53ff9 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:03.408118 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fefb5c-58b4-44cc-920b-ddcf5fde816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:03.408821 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fefb5c-58b4-44cc-920b-ddcf5fde816b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:03.409106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fefb5c-58b4-44cc-920b-ddcf5fde816b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:03.409381 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fefb5c-58b4-44cc-920b-ddcf5fde816b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:03.410114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fefb5c-58b4-44cc-920b-ddcf5fde816b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:03.411774 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fefb5c-58b4-44cc-920b-ddcf5fde816b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:03.421909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1429/2873] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:29:03.425772 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908eb92-8a3e-43e6-8033-802fb2d0834b admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:03.436014 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908eb92-8a3e-43e6-8033-802fb2d0834b admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:03.440571 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7436403-4df2-41a4-b5f0-c9f7aa4d396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:03.441454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7436403-4df2-41a4-b5f0-c9f7aa4d396d admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:03.441744 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7436403-4df2-41a4-b5f0-c9f7aa4d396d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:03.442027 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7436403-4df2-41a4-b5f0-c9f7aa4d396d admin admin] PATH_INFO: `/v3/projects/26ea645f55e7430abcbe0fdd416daf5d/users/f7c5c4db92c3498a98a840d29d13bd9e/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:03.457146 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7436403-4df2-41a4-b5f0-c9f7aa4d396d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ea645f55e7430abcbe0fdd416daf5d, user_id=f7c5c4db92c3498a98a840d29d13bd9e, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:03.459797 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7436403-4df2-41a4-b5f0-c9f7aa4d396d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:03.472921 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1445/2874] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:29:03 2022] PUT /identity/v3/projects/26ea645f55e7430abcbe0fdd416daf5d/users/f7c5c4db92c3498a98a840d29d13bd9e/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:29:03.484555 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23311321-df5a-4e1d-aec9-180ad2471cf3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:03.484897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23311321-df5a-4e1d-aec9-180ad2471cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:03.485199 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23311321-df5a-4e1d-aec9-180ad2471cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:03.512876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-23311321-df5a-4e1d-aec9-180ad2471cf3 None None] MFA Rules not processed for user `f7c5c4db92c3498a98a840d29d13bd9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:29:03.514096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-23311321-df5a-4e1d-aec9-180ad2471cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:03.578081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1430/2875] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:29:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:29:03.589251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7436403-4df2-41a4-b5f0-c9f7aa4d396d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:03.590940 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f7436403-4df2-41a4-b5f0-c9f7aa4d396d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:03.649530 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7436403-4df2-41a4-b5f0-c9f7aa4d396d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:03.653333 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3cb2b-bc3d-421e-8a14-ae98d7c555cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:03.653977 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3cb2b-bc3d-421e-8a14-ae98d7c555cd service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:03.654265 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3cb2b-bc3d-421e-8a14-ae98d7c555cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:03.654550 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3cb2b-bc3d-421e-8a14-ae98d7c555cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:03.662790 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3cb2b-bc3d-421e-8a14-ae98d7c555cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:03.664230 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3cb2b-bc3d-421e-8a14-ae98d7c555cd service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:03.673399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1446/2876] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:29:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:29:13.575110 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=39 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:13.669381 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:36.321670 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23311321-df5a-4e1d-aec9-180ad2471cf3 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:36.382818 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23311321-df5a-4e1d-aec9-180ad2471cf3 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:36.387336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:36.388203 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:36.388488 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:36.388798 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] PATH_INFO: `/v3/users/f7c5c4db92c3498a98a840d29d13bd9e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:36.389981 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c5c4db92c3498a98a840d29d13bd9e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:36.392218 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:36.437704 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c5c4db92c3498a98a840d29d13bd9e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:36.445177 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c5c4db92c3498a98a840d29d13bd9e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:36.445820 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c5c4db92c3498a98a840d29d13bd9e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:36.446429 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c5c4db92c3498a98a840d29d13bd9e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:36.458445 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c5c4db92c3498a98a840d29d13bd9e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:36.470490 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1431/2877] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:29:36 2022] DELETE /identity/v3/users/f7c5c4db92c3498a98a840d29d13bd9e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:29:36.475134 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebd76d-4168-4204-ae9d-97b1e63ba341 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:36.475625 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebd76d-4168-4204-ae9d-97b1e63ba341 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:36.475742 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebd76d-4168-4204-ae9d-97b1e63ba341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:36.499868 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-f6ebd76d-4168-4204-ae9d-97b1e63ba341 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:29:36.501761 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f6ebd76d-4168-4204-ae9d-97b1e63ba341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:36.561066 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1447/2878] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:29:36.571018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:36.572404 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:36.632076 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e157354-6f22-46ac-a1ba-622e0ee791ac admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:36.635796 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0c060-9db2-4fb7-97cb-918794d85426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:36.636493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c060-9db2-4fb7-97cb-918794d85426 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:36.636822 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c060-9db2-4fb7-97cb-918794d85426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:36.637104 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c060-9db2-4fb7-97cb-918794d85426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:36.646452 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0c060-9db2-4fb7-97cb-918794d85426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:36.647932 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0c060-9db2-4fb7-97cb-918794d85426 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:36.657853 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1432/2879] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:29:36.917990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebd76d-4168-4204-ae9d-97b1e63ba341 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:36.919432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-f6ebd76d-4168-4204-ae9d-97b1e63ba341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:36.932281 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebd76d-4168-4204-ae9d-97b1e63ba341 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:36.937104 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:36.938176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:36.938470 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:36.938751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] PATH_INFO: `/v3/projects/26ea645f55e7430abcbe0fdd416daf5d` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:36.940101 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ea645f55e7430abcbe0fdd416daf5d)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:36.942069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:36.990695 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ea645f55e7430abcbe0fdd416daf5d', 'request_id': 'req-df26e629-1a71-49f5-b48b-b7ad79ba4247'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:36.997029 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ea645f55e7430abcbe0fdd416daf5d', 'request_id': 'req-df26e629-1a71-49f5-b48b-b7ad79ba4247'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:37.004389 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ea645f55e7430abcbe0fdd416daf5d', 'request_id': 'req-df26e629-1a71-49f5-b48b-b7ad79ba4247'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:37.014545 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] The token cache is being invalidate because project 26ea645f55e7430abcbe0fdd416daf5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80271) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:29:37.014834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:37.015461 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-df26e629-1a71-49f5-b48b-b7ad79ba4247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:29:37.017838 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1448/2880] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:29:36 2022] DELETE /identity/v3/projects/26ea645f55e7430abcbe0fdd416daf5d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:29:37.022650 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2c06-5ff8-48ea-9bbd-7cdc080d2ec8 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:37.022943 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2c06-5ff8-48ea-9bbd-7cdc080d2ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:37.023221 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2c06-5ff8-48ea-9bbd-7cdc080d2ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:37.042167 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a5da2c06-5ff8-48ea-9bbd-7cdc080d2ec8 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:29:37.043356 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a5da2c06-5ff8-48ea-9bbd-7cdc080d2ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:37.060096 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:37.104964 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1433/2881] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:29:37.112811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d8e3-1134-4016-957e-3b14ca404ad5 None None] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:37.113111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d8e3-1134-4016-957e-3b14ca404ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:37.113393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d8e3-1134-4016-957e-3b14ca404ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:37.131589 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.auth.core [None req-da42d8e3-1134-4016-957e-3b14ca404ad5 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80271) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:29:37.132826 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-da42d8e3-1134-4016-957e-3b14ca404ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:37.140941 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1449/2882] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:29:37.145489 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da2c06-5ff8-48ea-9bbd-7cdc080d2ec8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:37.154980 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da2c06-5ff8-48ea-9bbd-7cdc080d2ec8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:37.160093 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5a3a6-889e-4d50-9f33-ab66bc39f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:37.160784 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a3a6-889e-4d50-9f33-ab66bc39f084 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:37.161075 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a3a6-889e-4d50-9f33-ab66bc39f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:37.161353 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a3a6-889e-4d50-9f33-ab66bc39f084 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:37.162078 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5a3a6-889e-4d50-9f33-ab66bc39f084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:29:37.162389 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5a3a6-889e-4d50-9f33-ab66bc39f084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:37.163982 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5a3a6-889e-4d50-9f33-ab66bc39f084 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:37.175723 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1434/2883] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jun 20 06:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:29:37.179906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d8e3-1134-4016-957e-3b14ca404ad5 None None] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:37.189256 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d8e3-1134-4016-957e-3b14ca404ad5 None None] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:37.193990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e04c8-3eb4-4d5c-875e-225ff1cf9b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:37.194641 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e04c8-3eb4-4d5c-875e-225ff1cf9b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:37.194927 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e04c8-3eb4-4d5c-875e-225ff1cf9b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:37.195204 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e04c8-3eb4-4d5c-875e-225ff1cf9b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:37.195898 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e04c8-3eb4-4d5c-875e-225ff1cf9b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:37.197828 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e04c8-3eb4-4d5c-875e-225ff1cf9b35 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:37.223830 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1450/2884] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jun 20 06:29:37 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:29:37.228040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5a3a6-889e-4d50-9f33-ab66bc39f084 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:37.238754 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5a3a6-889e-4d50-9f33-ab66bc39f084 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:37.298006 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f5c98-a365-445e-8d61-41c85aa2f201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:37.298690 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f5c98-a365-445e-8d61-41c85aa2f201 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:37.298990 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f5c98-a365-445e-8d61-41c85aa2f201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:37.299377 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f5c98-a365-445e-8d61-41c85aa2f201 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:37.300065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f5c98-a365-445e-8d61-41c85aa2f201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:37.302033 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f5c98-a365-445e-8d61-41c85aa2f201 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:37.321663 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1435/2885] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jun 20 06:29:37 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:29:37.325778 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e04c8-3eb4-4d5c-875e-225ff1cf9b35 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:37.337103 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e04c8-3eb4-4d5c-875e-225ff1cf9b35 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:37.341756 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082725b-9540-4fef-b6e6-aa4513653bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:37.342418 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082725b-9540-4fef-b6e6-aa4513653bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:37.342705 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082725b-9540-4fef-b6e6-aa4513653bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:37.342985 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082725b-9540-4fef-b6e6-aa4513653bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:37.343715 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082725b-9540-4fef-b6e6-aa4513653bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:37.345953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082725b-9540-4fef-b6e6-aa4513653bbe admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:37.356305 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1451/2886] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:29:37.362000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f5c98-a365-445e-8d61-41c85aa2f201 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:37.371832 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f5c98-a365-445e-8d61-41c85aa2f201 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:37.377823 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbdcff-50ab-43a3-831f-0791a989718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:37.378484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbdcff-50ab-43a3-831f-0791a989718c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:37.378775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbdcff-50ab-43a3-831f-0791a989718c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:37.379058 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbdcff-50ab-43a3-831f-0791a989718c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:37.379786 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbdcff-50ab-43a3-831f-0791a989718c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:37.381511 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbdcff-50ab-43a3-831f-0791a989718c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:37.391952 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1436/2887] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jun 20 06:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:29:37.396012 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082725b-9540-4fef-b6e6-aa4513653bbe admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:37.405911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082725b-9540-4fef-b6e6-aa4513653bbe admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:37.411016 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ea9df-2dbe-4d9a-976a-51bddf40337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:37.411884 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ea9df-2dbe-4d9a-976a-51bddf40337d admin admin] REQUEST_METHOD: `PUT` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:37.412168 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ea9df-2dbe-4d9a-976a-51bddf40337d admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:37.412448 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ea9df-2dbe-4d9a-976a-51bddf40337d admin admin] PATH_INFO: `/v3/projects/f6b94aef224741cb9def7826949c807d/users/0f3460128baa4bcf883974cfd2dbc65b/roles/f5a5bdf6fee0438391dd54c5b545305e` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:37.427247 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ea9df-2dbe-4d9a-976a-51bddf40337d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b94aef224741cb9def7826949c807d, user_id=0f3460128baa4bcf883974cfd2dbc65b, role_id=f5a5bdf6fee0438391dd54c5b545305e)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:37.429944 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ea9df-2dbe-4d9a-976a-51bddf40337d admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:37.443661 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1452/2888] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jun 20 06:29:37 2022] PUT /identity/v3/projects/f6b94aef224741cb9def7826949c807d/users/0f3460128baa4bcf883974cfd2dbc65b/roles/f5a5bdf6fee0438391dd54c5b545305e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:29:37.448604 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f271a-42cb-4fbe-8736-2699117d5515 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:37.448929 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f271a-42cb-4fbe-8736-2699117d5515 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:37.449209 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f271a-42cb-4fbe-8736-2699117d5515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:37.467648 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-fb8f271a-42cb-4fbe-8736-2699117d5515 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:29:37.468875 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fb8f271a-42cb-4fbe-8736-2699117d5515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:37.531126 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1437/2889] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:29:37.540857 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ea9df-2dbe-4d9a-976a-51bddf40337d admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:37.542839 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7d6ea9df-2dbe-4d9a-976a-51bddf40337d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:37.565396 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:37.602481 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ea9df-2dbe-4d9a-976a-51bddf40337d admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:37.606117 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bfc31-4c2c-4bb7-828f-8cbf664852bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:37.606808 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bfc31-4c2c-4bb7-828f-8cbf664852bc service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:37.607045 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bfc31-4c2c-4bb7-828f-8cbf664852bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:37.607322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bfc31-4c2c-4bb7-828f-8cbf664852bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:37.616377 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bfc31-4c2c-4bb7-828f-8cbf664852bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:37.617875 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bfc31-4c2c-4bb7-828f-8cbf664852bc service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:37.629111 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1453/2890] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:29:38.201316 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0412089-809c-4429-b72b-3bc224c34e10 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:38.201614 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0412089-809c-4429-b72b-3bc224c34e10 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:38.201897 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0412089-809c-4429-b72b-3bc224c34e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:38.229607 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e0412089-809c-4429-b72b-3bc224c34e10 None None] MFA Rules not processed for user `0f3460128baa4bcf883974cfd2dbc65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:29:38.230847 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e0412089-809c-4429-b72b-3bc224c34e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:38.247303 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:38.301619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1438/2891] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:29:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:29:38.312456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bfc31-4c2c-4bb7-828f-8cbf664852bc service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:38.314697 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-2e5bfc31-4c2c-4bb7-828f-8cbf664852bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:38.372900 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bfc31-4c2c-4bb7-828f-8cbf664852bc service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:38.377132 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15799b06-30f1-4645-9190-caadea784143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7071b87350864e478e848e7d3d66e33e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:38.377778 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799b06-30f1-4645-9190-caadea784143 service cinder] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:38.378062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799b06-30f1-4645-9190-caadea784143 service cinder] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:38.378341 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799b06-30f1-4645-9190-caadea784143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:38.386751 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15799b06-30f1-4645-9190-caadea784143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:38.388114 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15799b06-30f1-4645-9190-caadea784143 service cinder] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:38.397541 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1454/2892] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:29:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:29:39.786872 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c210fd-74f2-4b0c-91a6-1207c46f9e35 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:39.787422 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c210fd-74f2-4b0c-91a6-1207c46f9e35 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:39.787547 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c210fd-74f2-4b0c-91a6-1207c46f9e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:39.805081 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-51c210fd-74f2-4b0c-91a6-1207c46f9e35 None None] MFA Rules not processed for user `0f3460128baa4bcf883974cfd2dbc65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:29:39.806298 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-51c210fd-74f2-4b0c-91a6-1207c46f9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:39.813820 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1439/2893] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:29:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:29:39.852928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15799b06-30f1-4645-9190-caadea784143 service cinder] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:39.854322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-15799b06-30f1-4645-9190-caadea784143 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:39.953784 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15799b06-30f1-4645-9190-caadea784143 service cinder] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:39.957907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e74fd-69d2-4266-be75-42ad0bed4393 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3780488ee9404b3b8eda52acf8dceca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:39.958548 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e74fd-69d2-4266-be75-42ad0bed4393 service glance] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:39.958832 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e74fd-69d2-4266-be75-42ad0bed4393 service glance] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:39.959108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e74fd-69d2-4266-be75-42ad0bed4393 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:39.960917 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-7a9e74fd-69d2-4266-be75-42ad0bed4393 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:40.017095 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=100 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:40.033629 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e74fd-69d2-4266-be75-42ad0bed4393 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:40.035069 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e74fd-69d2-4266-be75-42ad0bed4393 service glance] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:40.046399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1455/2894] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:29:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:29:40.568733 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c210fd-74f2-4b0c-91a6-1207c46f9e35 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:40.570105 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-51c210fd-74f2-4b0c-91a6-1207c46f9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:40.582483 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c210fd-74f2-4b0c-91a6-1207c46f9e35 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:40.586102 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9bb61-2c8e-4e3a-9c69-5fb879144e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:40.586780 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9bb61-2c8e-4e3a-9c69-5fb879144e9c service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:40.587065 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9bb61-2c8e-4e3a-9c69-5fb879144e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:40.587344 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9bb61-2c8e-4e3a-9c69-5fb879144e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:40.589692 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-22e9bb61-2c8e-4e3a-9c69-5fb879144e9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:40.604161 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9bb61-2c8e-4e3a-9c69-5fb879144e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:40.605628 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9bb61-2c8e-4e3a-9c69-5fb879144e9c service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:40.627652 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1440/2895] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:29:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:29:42.182599 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e74fd-69d2-4266-be75-42ad0bed4393 service glance] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:29:42.192351 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e74fd-69d2-4266-be75-42ad0bed4393 service glance] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:29:42.195954 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c666c-bb75-4355-ba16-b84d76ac8583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:29:42.196596 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c666c-bb75-4355-ba16-b84d76ac8583 service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:29:42.196911 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c666c-bb75-4355-ba16-b84d76ac8583 service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:29:42.197191 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c666c-bb75-4355-ba16-b84d76ac8583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:29:42.198972 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-005c666c-bb75-4355-ba16-b84d76ac8583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:29:42.208631 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c666c-bb75-4355-ba16-b84d76ac8583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:29:42.210071 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c666c-bb75-4355-ba16-b84d76ac8583 service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:29:42.218118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1456/2896] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:29:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:29:50.612313 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=28 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:29:52.214551 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=12 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:10.407655 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203c77-12b0-4d21-83e0-c76cba14bf8d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:10.408131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203c77-12b0-4d21-83e0-c76cba14bf8d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:10.408244 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203c77-12b0-4d21-83e0-c76cba14bf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:10.427069 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ea203c77-12b0-4d21-83e0-c76cba14bf8d None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:30:10.428258 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ea203c77-12b0-4d21-83e0-c76cba14bf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:10.437040 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1441/2897] 10.222.0.33 () {58 vars in 1016 bytes} [Mon Jun 20 06:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:30:10.458928 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c666c-bb75-4355-ba16-b84d76ac8583 service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:10.460443 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-005c666c-bb75-4355-ba16-b84d76ac8583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:10.475923 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c666c-bb75-4355-ba16-b84d76ac8583 service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:10.482322 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfe24c-f903-4faa-bdda-554ef4f7c5a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:10.482953 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe24c-f903-4faa-bdda-554ef4f7c5a9 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:10.483235 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe24c-f903-4faa-bdda-554ef4f7c5a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:10.483511 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe24c-f903-4faa-bdda-554ef4f7c5a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:10.491673 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfe24c-f903-4faa-bdda-554ef4f7c5a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:10.493288 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfe24c-f903-4faa-bdda-554ef4f7c5a9 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:10.503171 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1457/2898] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:30:13.487351 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a0eb3-6b24-41b7-ae1c-b89a5d9cef6c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:13.487894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a0eb3-6b24-41b7-ae1c-b89a5d9cef6c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:13.487894 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a0eb3-6b24-41b7-ae1c-b89a5d9cef6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:13.506419 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-215a0eb3-6b24-41b7-ae1c-b89a5d9cef6c None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:30:13.507627 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-215a0eb3-6b24-41b7-ae1c-b89a5d9cef6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:13.517038 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1442/2899] 10.222.0.33 () {58 vars in 1016 bytes} [Mon Jun 20 06:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:30:13.536989 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfe24c-f903-4faa-bdda-554ef4f7c5a9 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:13.538456 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-afbfe24c-f903-4faa-bdda-554ef4f7c5a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:13.553493 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfe24c-f903-4faa-bdda-554ef4f7c5a9 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:13.559822 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c9bb8-b31e-444c-9b83-7a84bfbaca62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:13.560454 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c9bb8-b31e-444c-9b83-7a84bfbaca62 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:13.560777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c9bb8-b31e-444c-9b83-7a84bfbaca62 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:13.561057 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c9bb8-b31e-444c-9b83-7a84bfbaca62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:13.569190 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c9bb8-b31e-444c-9b83-7a84bfbaca62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:13.570763 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c9bb8-b31e-444c-9b83-7a84bfbaca62 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:13.580780 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1458/2900] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:30:16.726319 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23872782-b385-41f4-b44c-1c5e973829a7 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:16.727179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23872782-b385-41f4-b44c-1c5e973829a7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:16.727179 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23872782-b385-41f4-b44c-1c5e973829a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:16.745548 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-23872782-b385-41f4-b44c-1c5e973829a7 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:30:16.746782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-23872782-b385-41f4-b44c-1c5e973829a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:16.754410 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1443/2901] 10.222.0.33 () {58 vars in 1016 bytes} [Mon Jun 20 06:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:30:16.774738 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c9bb8-b31e-444c-9b83-7a84bfbaca62 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:16.786417 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c9bb8-b31e-444c-9b83-7a84bfbaca62 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:16.792148 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620edd4-ec48-4a01-88ca-1c9b8ffe73d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:16.793464 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620edd4-ec48-4a01-88ca-1c9b8ffe73d9 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:16.793748 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620edd4-ec48-4a01-88ca-1c9b8ffe73d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:16.794026 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620edd4-ec48-4a01-88ca-1c9b8ffe73d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:16.802887 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620edd4-ec48-4a01-88ca-1c9b8ffe73d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:16.804479 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620edd4-ec48-4a01-88ca-1c9b8ffe73d9 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:16.813990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1459/2902] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:30:19.806876 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c49f62-288c-47fb-8b01-c908b86b9aab None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:19.807376 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c49f62-288c-47fb-8b01-c908b86b9aab None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:19.807493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c49f62-288c-47fb-8b01-c908b86b9aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:19.825706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-60c49f62-288c-47fb-8b01-c908b86b9aab None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:30:19.826913 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-60c49f62-288c-47fb-8b01-c908b86b9aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:19.834859 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1444/2903] 10.222.0.33 () {58 vars in 1016 bytes} [Mon Jun 20 06:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:30:19.856510 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620edd4-ec48-4a01-88ca-1c9b8ffe73d9 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:19.867812 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620edd4-ec48-4a01-88ca-1c9b8ffe73d9 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:19.873479 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02272d-6f91-4988-93ff-ca471c8468ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:19.874108 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02272d-6f91-4988-93ff-ca471c8468ab service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:19.874393 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02272d-6f91-4988-93ff-ca471c8468ab service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:19.874721 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02272d-6f91-4988-93ff-ca471c8468ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:19.882771 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02272d-6f91-4988-93ff-ca471c8468ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:19.884337 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02272d-6f91-4988-93ff-ca471c8468ab service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:19.894212 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1460/2904] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:30:23.999336 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd0e96-b4ff-4adc-9ffc-c237c88ea304 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:23.999775 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd0e96-b4ff-4adc-9ffc-c237c88ea304 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:23.999885 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd0e96-b4ff-4adc-9ffc-c237c88ea304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:24.019905 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b5cd0e96-b4ff-4adc-9ffc-c237c88ea304 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:30:24.021151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b5cd0e96-b4ff-4adc-9ffc-c237c88ea304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:24.029884 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1445/2905] 10.222.0.33 () {58 vars in 1016 bytes} [Mon Jun 20 06:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:30:24.053570 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02272d-6f91-4988-93ff-ca471c8468ab service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:24.066221 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02272d-6f91-4988-93ff-ca471c8468ab service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:24.071907 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bf601-045a-49c8-89ad-afc02f5fb4e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:24.072602 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bf601-045a-49c8-89ad-afc02f5fb4e0 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:24.072930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bf601-045a-49c8-89ad-afc02f5fb4e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:24.073210 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bf601-045a-49c8-89ad-afc02f5fb4e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:24.081494 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bf601-045a-49c8-89ad-afc02f5fb4e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:24.083082 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bf601-045a-49c8-89ad-afc02f5fb4e0 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:24.093078 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1461/2906] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:30:27.163871 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d528-cca1-49dd-99ef-1eeda4abc76f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:27.164372 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d528-cca1-49dd-99ef-1eeda4abc76f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:27.164487 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d528-cca1-49dd-99ef-1eeda4abc76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:27.182581 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7ae1d528-cca1-49dd-99ef-1eeda4abc76f None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:30:27.183782 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7ae1d528-cca1-49dd-99ef-1eeda4abc76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:27.192151 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1446/2907] 10.222.0.33 () {58 vars in 1016 bytes} [Mon Jun 20 06:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:30:27.214969 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bf601-045a-49c8-89ad-afc02f5fb4e0 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:27.226376 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bf601-045a-49c8-89ad-afc02f5fb4e0 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:27.231904 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a16c2c-d6f9-47a5-95d3-cb2163ab3cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:27.232543 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a16c2c-d6f9-47a5-95d3-cb2163ab3cef service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:27.232862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a16c2c-d6f9-47a5-95d3-cb2163ab3cef service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:27.233142 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a16c2c-d6f9-47a5-95d3-cb2163ab3cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:27.241282 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a16c2c-d6f9-47a5-95d3-cb2163ab3cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:27.242862 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a16c2c-d6f9-47a5-95d3-cb2163ab3cef service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:27.254064 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1462/2908] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:30:37.177442 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=18 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:37.249686 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=36 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:42.199864 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceb258-ce9b-47f1-8dbd-f1197e8006d4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:42.200370 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceb258-ce9b-47f1-8dbd-f1197e8006d4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:42.200484 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceb258-ce9b-47f1-8dbd-f1197e8006d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:42.218927 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-35ceb258-ce9b-47f1-8dbd-f1197e8006d4 None None] MFA Rules not processed for user `0f3460128baa4bcf883974cfd2dbc65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:30:42.220170 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-35ceb258-ce9b-47f1-8dbd-f1197e8006d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:42.228091 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1447/2909] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jun 20 06:30:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:30:42.462833 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a16c2c-d6f9-47a5-95d3-cb2163ab3cef service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:42.473086 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a16c2c-d6f9-47a5-95d3-cb2163ab3cef service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:42.476804 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b22108-e1ac-46c8-b6cd-c248686e65aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21089ce5b140ab9549816b8cb38316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:42.477447 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b22108-e1ac-46c8-b6cd-c248686e65aa service neutron] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:42.477737 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b22108-e1ac-46c8-b6cd-c248686e65aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:42.478022 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b22108-e1ac-46c8-b6cd-c248686e65aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:42.479834 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-66b22108-e1ac-46c8-b6cd-c248686e65aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:42.490361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b22108-e1ac-46c8-b6cd-c248686e65aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:42.491803 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b22108-e1ac-46c8-b6cd-c248686e65aa service neutron] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:42.500254 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1463/2910] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:30:52.213242 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:52.496405 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=6 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:30:56.354928 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645bccc-c161-4a33-a2fb-2cd981a3f557 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:56.355493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645bccc-c161-4a33-a2fb-2cd981a3f557 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:56.355493 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645bccc-c161-4a33-a2fb-2cd981a3f557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:56.373222 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a645bccc-c161-4a33-a2fb-2cd981a3f557 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:30:56.374481 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a645bccc-c161-4a33-a2fb-2cd981a3f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:56.383139 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1448/2911] 10.222.0.33 () {58 vars in 1016 bytes} [Mon Jun 20 06:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:30:56.402343 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b22108-e1ac-46c8-b6cd-c248686e65aa service neutron] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:56.415821 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b22108-e1ac-46c8-b6cd-c248686e65aa service neutron] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:56.421563 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0477323-24a3-4cd7-b6e2-6fa1d1f36021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:56.422195 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477323-24a3-4cd7-b6e2-6fa1d1f36021 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:56.422477 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477323-24a3-4cd7-b6e2-6fa1d1f36021 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:56.422753 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477323-24a3-4cd7-b6e2-6fa1d1f36021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:56.431496 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0477323-24a3-4cd7-b6e2-6fa1d1f36021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:56.433096 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0477323-24a3-4cd7-b6e2-6fa1d1f36021 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:56.442313 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1464/2912] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:30:59.615114 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1596-6ee1-4448-9c6d-eab735e52aa6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:59.615669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1596-6ee1-4448-9c6d-eab735e52aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:59.615669 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1596-6ee1-4448-9c6d-eab735e52aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:59.634680 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0bfb1596-6ee1-4448-9c6d-eab735e52aa6 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:30:59.635887 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0bfb1596-6ee1-4448-9c6d-eab735e52aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:30:59.643801 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1449/2913] 10.222.0.33 () {58 vars in 1016 bytes} [Mon Jun 20 06:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:30:59.664906 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0477323-24a3-4cd7-b6e2-6fa1d1f36021 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:30:59.676378 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0477323-24a3-4cd7-b6e2-6fa1d1f36021 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:30:59.682020 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1212da9-fffd-4f3f-a70f-79e0b7efa5f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:30:59.682652 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1212da9-fffd-4f3f-a70f-79e0b7efa5f3 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:30:59.682942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1212da9-fffd-4f3f-a70f-79e0b7efa5f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:30:59.683225 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1212da9-fffd-4f3f-a70f-79e0b7efa5f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:30:59.691346 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1212da9-fffd-4f3f-a70f-79e0b7efa5f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:30:59.693055 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1212da9-fffd-4f3f-a70f-79e0b7efa5f3 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:30:59.702361 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1465/2914] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:31:02.687495 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398d49c-4295-40d6-9523-eb03c69c6edd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:31:02.687988 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398d49c-4295-40d6-9523-eb03c69c6edd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:31:02.688097 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398d49c-4295-40d6-9523-eb03c69c6edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:31:02.706641 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f398d49c-4295-40d6-9523-eb03c69c6edd None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:31:02.708311 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f398d49c-4295-40d6-9523-eb03c69c6edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:31:02.716009 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1450/2915] 10.222.0.33 () {58 vars in 1016 bytes} [Mon Jun 20 06:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:31:02.736236 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1212da9-fffd-4f3f-a70f-79e0b7efa5f3 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:31:02.748008 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1212da9-fffd-4f3f-a70f-79e0b7efa5f3 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:31:02.753463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2bfd6-d631-4948-831c-249a9ec64ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:31:02.755062 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2bfd6-d631-4948-831c-249a9ec64ae4 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:31:02.755353 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2bfd6-d631-4948-831c-249a9ec64ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:31:02.755628 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2bfd6-d631-4948-831c-249a9ec64ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:31:02.764144 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2bfd6-d631-4948-831c-249a9ec64ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:31:02.765811 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2bfd6-d631-4948-831c-249a9ec64ae4 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:31:02.775559 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1466/2916] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:31:05.845580 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ab818-b0ce-4ffc-a80e-556743d2bb58 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:31:05.846095 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ab818-b0ce-4ffc-a80e-556743d2bb58 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:31:05.846204 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ab818-b0ce-4ffc-a80e-556743d2bb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:31:05.864867 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-de2ab818-b0ce-4ffc-a80e-556743d2bb58 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:31:05.866082 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-de2ab818-b0ce-4ffc-a80e-556743d2bb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:31:05.874327 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1451/2917] 10.222.0.33 () {58 vars in 1016 bytes} [Mon Jun 20 06:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:31:05.898098 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2bfd6-d631-4948-831c-249a9ec64ae4 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:31:05.909185 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2bfd6-d631-4948-831c-249a9ec64ae4 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:31:05.914825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8446ce-d7e4-4ff7-a3aa-52f719881444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:31:05.915492 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8446ce-d7e4-4ff7-a3aa-52f719881444 service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:31:05.915777 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8446ce-d7e4-4ff7-a3aa-52f719881444 service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:31:05.916054 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8446ce-d7e4-4ff7-a3aa-52f719881444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:31:05.924532 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8446ce-d7e4-4ff7-a3aa-52f719881444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:31:05.926207 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8446ce-d7e4-4ff7-a3aa-52f719881444 service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:31:05.935701 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1467/2918] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:31:09.000420 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc737e3-e519-4f82-a6ab-86a83b33eb98 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:31:09.001018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc737e3-e519-4f82-a6ab-86a83b33eb98 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:31:09.001018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc737e3-e519-4f82-a6ab-86a83b33eb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:31:09.018638 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-abc737e3-e519-4f82-a6ab-86a83b33eb98 None None] MFA Rules not processed for user `c3f241eb29634e3ba6cabbf8247be6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:31:09.019868 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-abc737e3-e519-4f82-a6ab-86a83b33eb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:31:09.028176 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1452/2919] 10.222.0.33 () {58 vars in 1016 bytes} [Mon Jun 20 06:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:31:09.051586 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8446ce-d7e4-4ff7-a3aa-52f719881444 service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:31:09.063251 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8446ce-d7e4-4ff7-a3aa-52f719881444 service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:31:09.068867 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6de6e-5e15-4c1b-8164-70b5110ad87f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3748d8369d20429eb2376ce02d42eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:31:09.069505 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6de6e-5e15-4c1b-8164-70b5110ad87f service nova] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:31:09.069788 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6de6e-5e15-4c1b-8164-70b5110ad87f service nova] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:31:09.070063 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6de6e-5e15-4c1b-8164-70b5110ad87f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:31:09.077990 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6de6e-5e15-4c1b-8164-70b5110ad87f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:31:09.079553 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6de6e-5e15-4c1b-8164-70b5110ad87f service nova] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:31:09.088930 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1468/2920] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:31:19.013623 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=15 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:31:19.084817 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=30 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:31:30.655978 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc737e3-e519-4f82-a6ab-86a83b33eb98 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:31:30.658106 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-abc737e3-e519-4f82-a6ab-86a83b33eb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:31:30.729018 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc737e3-e519-4f82-a6ab-86a83b33eb98 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:31:30.733967 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b042631-6cac-420b-b0e2-156662d112df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:31:30.734619 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042631-6cac-420b-b0e2-156662d112df service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:31:30.734909 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042631-6cac-420b-b0e2-156662d112df service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:31:30.735189 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042631-6cac-420b-b0e2-156662d112df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:31:30.737127 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6b042631-6cac-420b-b0e2-156662d112df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:31:30.748836 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b042631-6cac-420b-b0e2-156662d112df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:31:30.750578 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b042631-6cac-420b-b0e2-156662d112df service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:31:30.760706 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1453/2921] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:31:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:31:36.862118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6de6e-5e15-4c1b-8164-70b5110ad87f service nova] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:31:36.873584 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6de6e-5e15-4c1b-8164-70b5110ad87f service nova] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:31:36.878936 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:31:36.880518 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:31:36.881338 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:31:36.881621 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] PATH_INFO: `/v3/users/0f3460128baa4bcf883974cfd2dbc65b` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:31:36.882825 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3460128baa4bcf883974cfd2dbc65b)` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:31:36.884942 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:31:36.934371 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3460128baa4bcf883974cfd2dbc65b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:31:36.941118 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3460128baa4bcf883974cfd2dbc65b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:31:36.941775 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3460128baa4bcf883974cfd2dbc65b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:31:36.942432 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3460128baa4bcf883974cfd2dbc65b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:31:36.954587 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.notifications [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3460128baa4bcf883974cfd2dbc65b'} {{(pid=80271) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:31:36.967816 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1469/2922] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jun 20 06:31:36 2022] DELETE /identity/v3/users/0f3460128baa4bcf883974cfd2dbc65b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:31:37.142000 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b042631-6cac-420b-b0e2-156662d112df service placement] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:31:37.153010 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b042631-6cac-420b-b0e2-156662d112df service placement] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:31:37.212228 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f241eb29634e3ba6cabbf8247be6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8cc051ad1a43a898b15611374a54c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:31:37.213122 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:31:37.213415 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:31:37.213700 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] PATH_INFO: `/v3/projects/f6b94aef224741cb9def7826949c807d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:31:37.214888 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b94aef224741cb9def7826949c807d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:31:37.216852 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:31:37.262131 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b94aef224741cb9def7826949c807d', 'request_id': 'req-348ce2b9-ae2b-4a89-8f76-f68722be009d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:31:37.268140 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b94aef224741cb9def7826949c807d', 'request_id': 'req-348ce2b9-ae2b-4a89-8f76-f68722be009d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:31:37.274724 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b94aef224741cb9def7826949c807d', 'request_id': 'req-348ce2b9-ae2b-4a89-8f76-f68722be009d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:31:37.287496 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] The token cache is being invalidate because project f6b94aef224741cb9def7826949c807d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:31:37.287785 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:31:37.288403 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-348ce2b9-ae2b-4a89-8f76-f68722be009d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:31:37.289979 dv-cinder-804735-31-smb devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1454/2923] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jun 20 06:31:37 2022] DELETE /identity/v3/projects/f6b94aef224741cb9def7826949c807d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:31:46.964176 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG dbcounter [-] [80271] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:31:47.284120 dv-cinder-804735-31-smb devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:36:35.659310 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] Authenticating user token {{(pid=80271) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:36:35.660752 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:36:35.755815 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f1c0c-7c82-4344-9803-c01a2670de26 admin admin] Validating token access rules against request {{(pid=80271) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:36:35.814514 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d3484-98c7-4f86-a93a-693f4f05ec30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '577f89ef22954926bdf02a15484f8f17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c57a2daa2948400ea8175d6aea22a68e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80271) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:36:35.815173 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d3484-98c7-4f86-a93a-693f4f05ec30 service placement] REQUEST_METHOD: `GET` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:36:35.815463 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d3484-98c7-4f86-a93a-693f4f05ec30 service placement] SCRIPT_NAME: `/identity` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:36:35.815743 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d3484-98c7-4f86-a93a-693f4f05ec30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80271) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:36:35.817534 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.fernet_utils [None req-270d3484-98c7-4f86-a93a-693f4f05ec30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80271) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:36:35.829399 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d3484-98c7-4f86-a93a-693f4f05ec30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:36:35.830994 dv-cinder-804735-31-smb devstack@keystone.service[80271]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d3484-98c7-4f86-a93a-693f4f05ec30 service placement] RBAC: Authorization granted {{(pid=80271) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:36:35.841670 dv-cinder-804735-31-smb devstack@keystone.service[80271]: [pid: 80271|app: 0|req: 1470/2924] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jun 20 06:36:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)